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An  Investigation  into  the  Validity  of 

Norms  With  Special  Reference  to 

Urban  and  Rural  Groups 


CHAPTER  I 

Introduction 

Mental  testing  requires  no  justification;  it  is  now  an  in- 
dispensable part  of  the  technique  of  the  educational  psy- 
chologist, the  vocational  expert  and  the  psychopathologist. 
Whereas  twenty-five  years  ago  the  available  psychological 
tests  could  have  been  described  in  a  pamphlet,  nowadays  whole 
books  on  tests  fill  our  shelves  and  the  supply  seems  in- 
exhaustible. 

This  rapid  growth  is  splendid  in  many  respects,  but  it  has 
led  inevitably  to  hasty  and  inaccurate  technique  in  many 
quarters.  In  a  recent  manual  on  tests  (8) ,  of  which  the  pres- 
ent writer  is  a  co-author,  126  rather  widely  used  tests  of  a 
certain  type  were  described.  Of  these  at  least  one-fifth  did 
not  attain  the  low  numerical  level  of  sample  which  we  had 
set  as  a  minimum  in  standardization.  Admitting  that  mere 
addition  of  numbers  does  not  necessarily  increase  validity,  it 
is,  nevertheless,  obvious  that  averages  based  on  a  sam- 
pling of  the  population  that  is  less  than  fifty  cases  have  lit- 
tle significance. 

The  applicability  of  norms,  however,  depends  on  many  other 
factors  besides  the  number  of  cases  on  which  the  tests  are 
standardized.  One  has  to  consider  the  composition  of  the 
group  from  the  standpoints  of  variability,  sex,  racial  and 
national  components,  etc.  Moreover,  the  original  scaling  of 
the  test  with  the  possible  favoring  of  one  group  to  the  exclu- 
sion of  others  must  be  taken  into  account. 

We  present  below  the  results  of  an  analysis  of  our  126  tests 
in  regard  to  the  selection  of  subjects.  Our  analysis  is  based 
on  the  data  included  in  the  original  articles.  As  stated  above, 
a  great  many  tests,  24.6%,  were  not  well  enough  standard- 
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ized  to  pass  even  our  low  numerical  requirements.  The  tests 
analyzed  below  represent,  then,  the  upper  75%  of  our  tests. 
We  believe  that  in  the  field  of  comparative  psychology — 
in  so  far  as  it  deals  with  the  comparison  of  one  human  group 
with  another — the  result  of  the  misuse  of  tests  has  been  most 
marked.  The  asserted  inferiority  of  any  group  over  another 
may,  perhaps,  be  laid  to  the  tools  utilized  in  the  analysis 
rather  than  to  any  intrinsic  differences  in  the  groups  them- 
selves. No  particular  comment  is  necessary.  These  figures 
speak  for  themselves. 


Table  I 

Sex 

Taken  into 

Consideration 

60.8% 

Not  Taken  into 

Consideration 

39.2% 

a,  A.D.,  P.E. 

Given 

39.2% 

Not  Given 
37.3% 

Not  Given  but  Could 

be  Figured  From 

Given  Data 

23.5% 

Racial  Composition 
Social  Composition 


Taken  into 
Consideration 

9.8% 
11.8% 


Not  Taken  into 
Consideration 

88.2% 
50.9% 


Some  Consider- 
ation Given 

2.0% 
37.3% 


Numbers 


Large 
59.0% 


Fairly  Large 

17.5% 


Adequate  Only 

At  Certain  Ages 

23.5% 


We  have  attacked  this  problem  in  the  following  manner: 
Having  prepared  two  tests  scaled  and  standardized  accord- 
ing to  the  best  known  methods,  we  have  used  them  in  the 
comparison  of  two  groups — urban  and  rural  children.  Our 
aim  is  twofold:  1.  to  examine  the  importance  of  the  differ- 
entiation of  norms  according  to  sex,  educational  groups,  lo- 
calities, racial  composition;  2.  to  inquire  whether  differences 
between  our  groups  are  a  function  of  the  group  mentality  or 
our  tests  as  tools. 

Each  chapter,  dealing  with  one  of  these  topics,  contains  a 
summary  of  the  pertinent  literature.  We  have  made  no  at- 
tempt to  be  exhaustive,  since  we  have  found  it  necessary  to 
draw  so  many  fields  into  our  discussion. 

Moreover,  our  research  itself  has  touched  only  the  fringes 
of  a  somewhat  unexplored  field.  Our  purpose  will  have  been 
accomplished  if  it  contributes  to  the  more  careful  scrutiny 
of  psychological  articles  on  race  and  group  differences. 


CHAPTER  II 
The  Construction  and  Standardization 

OF 

Information  Tests  A  and  B 

An  information  test  of  more  than  local  import,  adequately 
scaled  and  standardized,  and  adapted  to  clinical  use,  seemed 
to  offer  a  virgin  field  for  experimentation.  Of  the  few  in- 
formation tests  already  in  existence,  none  seemed  to  fill  these 
requirements. 

F.  Kuhlmann  and  T.  G.  Foran  were  kind  enough  to  send 
us  the  information  tests  which  they  use.  Neither  of  these 
has,  to  our  knowledge,  been  published  and  the  standardization, 
if  it  exists,  is  unavailable.  Doubtless  similar  material,  in 
more  or  less  embryonic  form,  is  utilized  in  clinics  all  over  the 
country. 

For  the  most  part,  vocabulary  tests  similar  to  that  in  the 
Stanford-Binet  have,  despite  certain  shortcomings,  been  used 
as  information  tests.  The  three  mentioned  below  have  been 
so  designated. 

Whipple's  "Range  of  Information"  test  is  merely  an  exten- 
sion of  his  vocabulary  test,  the  words  being  so  selected  "that 
each  shall  be  representative  of  some  specific  field  of  knowledge 
or  activity."^  From  a  performance  one  can  ascertain  the  fields 
with  which  the  subject  is  acquainted,  i.e.,  American  history, 
golf,  photography,  etc.  It  is  no  adequate  gauge  of  his  com- 
monsense  information  as  a  whole. 

Pressey  and  Shively,  in  1919  (2),  utilized  a  test  composed 
of  10  groups  of  10  words  each,  representing  10  different 
fields.  This  test  was  designed  to  fit  the  needs  of  delinquents 
and  since,  moreover,  it  was  loosely  organized  and  not  stand- 
ardized, it  need  not  concern  us  here. 

Weeks,  1928  (5),  constructed  the  Berkshire  test,  consist- 
ing of  three  sets  of  50  words  each  (one  taken  from  the  Stan- 
ford-Binet), to  be  defined  according  to  the  multiple  choice 
method,  e.g.,  pancreatic:  nerve  sweetbread  universal  panic- 
stricken. 

We  know  of  only  two  tests  at  all  similar  to  our  own : 

*  6,  p.  683. 
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Terman,  in  his  "Genetic  Studies  of  Genius"  (3),  mentions 
an  individual  information  test  devised  for  the  comparison  of 
average  and  gifted  children.  It  is  in  part  identical  with  the 
information  section  of  the  Stanford  Achievement  test,  but  is 
more  reliable  and  covers  a  wider  range.  Each  of  the  two 
forms  contains  335  items,  e.g.: 

The  earth  is  shaped  most  like  a  baseball,  football,  pear. 
The  house-fly  spreads  Bubonic  plague,  typhoid,  yellow  fever. 

This  is  an  extremely  good  test.  But  since  it  takes  an  hour 
to  administer,  it  would  have  been  impractical  for  our  purposes 
even  if  it  had  been  reported  before  we  started  our  investiga- 
tion. To  our  knowledge,  no  one  besides  Terman  has  pub- 
lished results  on  these  tests,  although  they  may  be  available 
in  printed  form.  The  test  is  not  reported  in  full  in  "Genetic 
Studies  of  Genius." 

Eastman,  in  1926  (1),  compiled  an  information  test  of  100 
questions  for  use  in  the  Wayne  psychopathic  clinic.  While 
admirably  adapted  for  the  use  for  which  it  was  intended,  its 
questions  are  extremely  local  in  scope,  (e.g.,  Name  five  car 
lines  in  Detroit) ,  and  thus  not  suited  to  our  purpose. 

The  following  paragraphs  describe  the  construction  and 
standardization  of  our  tests  A  and  B.  We  should  like  to  em- 
phasize the  fact  that  A  and  B  do  not  refer  to  alternative  forms. 
Whenever  the  A  test  is  referred  to,  it  should  be  thought  of 
as  the  test  scaled  on  urban  children,  whereas  the  B  test  was 
scaled  on  rural  children. 

Scaling  Information  A 
Construction.  The  first  step  in  the  construction  of  the  test 
was  the  preparation  of  the  material.  In  this  preliminary 
work,  we  were  fortunate  enough  to  have  the  cooperation  of  a 
group  of  teachers  of  elementary  and  high  schools.  Questions 
which  they  submitted  were  recast,  modified  and  supplemented 
until  we  had  eighty  questions^  of  varying  degrees  of  diffi- 
culty, covering  the  different  fields  of  commonsense  informa- 
tion, e.g.,  nature,  industry,  etc.  They  were  so  framed  that 
they  could  not  be  answered  by  "yes"  or  "no."  These  ques- 
tions were  then  mimeographed  on  two  sheets  (easy  and  hard 
questions  being  scattered  throughout  in  irregular  order)  and 
tried  out  on  764  urban  children  in  grades  4-12,  inclusive.    Not 
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more  than  two  grades  were  taken  from  the  same  school.    The 
distribution  of  cases  follows: 


Table  II 


Grades IV  V  VI         VII       VUI       IX  X  XI        XII 

No.  of  Cases         71  96  102         101  98         111  32  59  94 


Since  we  desired,  in  this  preliminary  tryout,  to  test  all  the 
questions  and  not  the  individual  children,  it  was  extremely  im- 
portant that  each  question  be  attempted  by  each  child.  We 
secured  the  cooperation  of  the  teachers  in  having  the  test 
given  over  a  period  of  two  or  three  days,  so  that  each  section 
should  be  given  due  emphasis. 

From  the  returns  we  calculated  the  %  of  correct  responses 
for  each  question.  These  %'s  were  converted  into  S.D.  units,^ 
as  may  be  seen  from  Table  III.  Unsatisfactory  questions 
(because  of  ambiguity  in  interpretation  or  difficulty  in  scor- 
ing) were  discarded.^ 

From  the  remaining  72  questions,  25  questions  were  selected 
in  such  a  manner  that  there  was  approximately  the  same  dis- 
tance in  S.D.  units  between  each  2  questions.  It  was  thus  pos- 
sible to  state  that  the  third  question  was  as  much  more  difficult 
than  the  second,  as  the  25th  question  was  more  difficult  than 


^  54  pp.  396-400.     Table  is  based  on  area  of  probability  curve,  assum- 
ing base  line  to  be  broken  off  at  ±  S.Oo-, 

^  *  Some  of  the  answers  encountered  in  scoring  the  papers  were  suffi- 
cient reward  for  the  labor  involved.  Some  of  these  gems  are  shared 
with  the  reader. 

11.  How  is  it  that  newspapers  can  be  sold  for  less  than  the  cost  of 
printing  them?     "Because  people  put  in  ads  about  divorces." 

25.  Name  three  precious  stones.     "Diamonds,  coal,  gold."     "Diamond, 
rubi,  Plymouth  Rock." 

26.  Why  is  the  moon  light  at  night?     "So  the  sun  can  rest."     "Be- 
cause it  is  made  of  cheese." 

54.  Where  does  Congress  meet?     "In  the  Gulf  of  Mexico." 

55.  What  is  a  civil  war?     "Where  2  enemies  fight  with  arms  agreed 
on  beforehand." 

58.  Why  did  the  Pilgrims  come  to  this  country?     "To  get  gold  and 
precious  stones." 

59.  How  many  sides  has  a  triangle?  "Any  number  of  unequal  sides." 
64.  What  is  the  freezing  point  of  water?  "North  and  South  Poles." 
69.  What  is  vaccination  for?     "To  rest  and  go  to  see  the  world."     "It 

is  a  permit  mark  on  a  child's  arm."     "To  show  you're  old  enough 

to  go  to  school." 
71.  Name  four  general  reasons  that  prevent  a  would-be  immigrant 

from  entering  the  United  States.    "Whisky,  Pistols,  Germs,  Piosnin." 
74.  Name  five  insects.     "Americans,   Italians,   Finnish,   Swedish  and 

Spaniard."     "vilin,  catar,  piano,  drum,  floot." 
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Table  III 
PRELIMINARY  SCALE  A 

Questions  Arranged  in  Order  of  DiflBculty  for  Urban  Children 


What  are  the  colors  in  the  American  flag? 

Of  what  are  shoes  made? 

How  many  cents  are  there  in  a  quarter? 

How  many  hours  are  there  in  a  day? 

What  may  we  expect  when  we  see  heavy  black  clouds? 

What  holiday  comes  in  December? 

How  do  you  know  a  policeman  when  you  see  him? 

What  is  our  national  song? 

Who  is  president  of  the  United  States? 

To  what  public  building  can  you  go  for  books? 

How  much  does  it  cost  to  mail  a  letter  to  any  city  in  the  U.  S.? 

What  people  were  in  America  when  the  white  men  came? 

Of  what  is  butter  made? 

What  state  do  you  live  in? 

What  holiday  do  we  now  celebrate  that  was  first  celebrated  by  the 

Pilgrims? 
How  many  sides  has  a  triangle? 
How  old  must  you  be  before  you  can  vote? 
Of  what  is  paper  made? 
How  many  months  are  there  in  a  year? 
Where  does  the  sun  rise? 
How  many  states  are  there  in  the  U.S.? 
Name  four  different  trees. 
Who  was  the  first  president  of  the  U.  S.? 
How  many  pints  are  there  in  a  quart? 
Name  five  vegetables. 

What  do  the  stars  in  the  American  flag  represent? 
What  is  the  capital  of  the  U.  S.? 
In  your  city,  what  is  the  youngest  age  at  which  a  child  can  leave 

school? 
What  is  the  shortest  month  in  the  year? 
What  is  the  largest  river  in  the  U.  S.? 
Why  did  the  Pilgrims  come  to  this  country? 
What  is  a  submarine  boat? 
Who  is  the  Governor  of  your  State? 
What  is  the  largest  city  in  the  U.S.? 

For  how  many  years  is  the  president  of  the  U.  S.  elected? 
Who  was  the  president  of  the  U.  S.  during  the  World  War? 
Name  three  precious  stones. 
Why  should  we  kill  flies? 
Why  is  it  dark  at  night? 

Name  a  country  in  Europe  which  is  a  republic. 
How  many  weeks  are  there  in  a  year? 
What  three  things  do  most  plants  need  in  order  to  live? 
Why  don't  we  see  the  stars  in  the  day  time? 
About  how  often  do  we  have  a  full  moon? 
Where  does  Congress  meet? 

How  does  the  beating  of  your  heart  keep  you  alive? 
What  is  the  value  of  the  smallest  silver  coin  we  use? 
What  causes  an  eclipse  of  the  sun? 
Why  do  we  celebrate  the  4th  of  July? 

What  artificial  waterway  connects  the  Atlantic  with  the  Pacific? 
Name  the  greatest  English  writer  of  plays? 
What  is  steam? 
What  form  of  government  have  we  in  the  U.  S.? 


<T      % 

Passing 

.72 

99.0 

.82 

98.7 

1.06 

97.5 

1.08 

97.4 

1.19 

96.6 

1.32 

95.5 

1.36 

95.1 

1.37 

95.0 

1.45 

94.1 

1.47 

93.8 

1.51 

93.3 

1.54 

92.9 

1.71 

90.3 

1.74 

89.8 

1.77 

89.2 

1.88 

87.1 

1.93 

85.9 

1.93 

85.9 

1.94 

85.8 

1.94 

85.8 

1.95 

85.5 

1.95 

85.5 

1.97 

85.1 

2.07 

82.7 

2.08 

82.3 

2.09 

82.1 

2.13 

81.0 

2.15 

80.5 

2.18 

79.7 

2.19 

79.3 

2.35 

74.5 

2.36 

74.2 

2.37 

73.7 

2.41 

72.3 

2.47 

70.5 

2.50 

69.4 

2.55 

67.7 

2.57 

66.9 

2.58 

66.7 

2.67 

63.2 

2.67 

63.2 

2.68 

62.7 

2.78 

59.0 

2.79 

58.6 

2.79 

58.6 

2.81 

57.7 

2.83 

57.1 

2.88 

55.1 

2.90 

54.3 

2.91 

53.7 

2.94 

52.5 

2.96 

51.8 

2.98 

51.1 

(7 

%  Passing 

3.05 

48.0 

3.06 

47.7 

3.24 

40.5 

3.31 

37.7 

3.33 

37.0 

3.38 

35.0 

3.39 

34.6 

3.41 

34.0 

3.47 

31.9 

3.58 

28.0 

3.72 

23.4 

3.88 

18.8 

4.02 

15.4 

4.12 

13.0 

4.28 

10.0 

4.39 

8.1 

4.43 

7.5 

4.82 

3.3 

5.19 

1.3 
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How  can  banks  afford  to  pay  interest  on  the  money  you  deposit? 

What  is  the  economic  value  of  Alaska  to  the  U.  S.? 

Name  five  insects. 

Of  what  is  rubber  made? 

What  is  a  civil  war? 

Why  is  the  moon  light  at  night? 

Name  two  stones  used  for  building  purposes. 

Name  five  cities  in  the  U.  S.  that  have  a  population  of  over  half  a 

million. 
Name  the  Great  Lakes. 
How  is  it  that  newspapers  can  be  sold  for  much  less  than  the  cost  of 

printing? 
What  is  the  freezing  point  of  water? 
What  is  the  usual  economic  result  of  the  over-production  of  any 

commodity? 
In  what  country  is  Vienna? 

In  what  month  of  the  year  do  the  days  begin  to  grow  shorter? 
What  are  the  functions  of  the  three  branches  of  oiu-  Government? 
(In  three  words  or  phrases.) 
Of  what  use  are  insects  to  flowers? 
Name  four  general  reasons  that  would  prevent  a  would-be  immigrant 

from  entering  the  U.  S. 
What  is  the  function  of  respiration? 
What  is  a  referendum  in  government? 


the  24th.  The  test,  as  it  appeared  in  its  final  printed  form,  is 
reproduced  on  the  following  page.^ 

Standardization.  As  subjects  in  the  standardization  of  this 
test  we  secured  the  entire  school  population  of  a  city  of  47,876 
inhabitants  (1920  Census).  This  city  was  considered  by  its 
assistant  superintendent  to  be  "average."  In  a  state  survey 
in  arithmetic  it  had  fallen  midway  in  the  distribution. 

The  method  of  T.  scaling,  described  in  detail  by  McCall,^ 
was  used  in  the  construction  and  standardization  of  Scaled 
Information  A.  This  probably  gives  more  accurate  results 
than  either  the  percentile  or  age  scales.  McCall  states  that 
"the  T  scale  is  believed  to  be  superior  to  any  of  the  previously 
described  methods.  ...  It  scales  the  total  score.  It  employs 
the  simple  total.  It  allows  each  test  element  done  to  affect  the 
scale  score,  thereby  increasing  reliability.  Its  units  are  equal 
in  the  generally  accepted  sense  at  all  points  on  the  scale."^ 

The  tests  were  all  administered  on  the  same  day  under  con- 
ditions as  nearly  standard  as  possible.  Each  teacher  gave  the 
test  to  her  own  pupils  following  precise  instructions.  Judg- 
ing from  our  contact  with  superintendent  and  staff  we  are 
confident  in  stating  that  the  conditions  under  which  these 


■*  This  test  can  be  obtained  from  Stoelting  &  Co.,  Chicago,  111. 
'  For  details,  see  53,  pp.  272-306. 
'  52,  p.  96. 
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A  SCALED  INFORMATION  TEST 


NamEl. 


SCHOOL. 


Age:  Ybs Mos._ 

Grade 


1.  What  are  the  colors  in  the  American  flag? 

2.  Of  what  are  shoes  made? 

3.  How  many  hours  are  there  in  a  day? 

4.  What  holiday  comes  in  December? 

5.  Who  is  President  of  the  United  States? 

6.  What  people  were  in  America  when  the  white 

men  came? 

7.  What  State  do  you  live  in? 

8.  Where  does  the  sun  rise? 

9.  Name  five  vegetables. 

10.  What  is  the  largest  river  in  the  United  States? 

11.  Why  did  the  Pilgrims  come  to  this  country? 

12.  For  how  many  years  is  the  President  of  the 

United  States  elected? 

13.  What  three  things  do  most  plants  need  in  order  to  live? 

14.  How  does  the  beating  of  your  heart  keep  you  alive? 

15.  How  can  banks  afiford  to  pay  interest  on  the  money  you  deposit? 

16.  Name  five  insects. 

17.  What  is  a  civil  war? 

18.  Name  five  cities  in  the  United  States  with  a  population  of  over  half  a  million. 

19.  How  is  it  that  newspapers  can  be  sold  for  less  than  the  cost  of  printing? 

20.  What  is  the  freezing  point  of  water? 

21.  What  is  the  usual  economic  resxilt  of  the  over-production  of  any  commodity? 

22.  What  are  the  functions  of  the  three  branches  of  our  government?  (In  three  words  or 

phrases). 

23.  Name  four  general  reasons  that  will  prevent  a  would-be  immigrant  from  entering 

the  United  States. 

24.  What  is  the  fimction  of  respiration? 

25.  What  is  a  referendum  in  government? 

group  tests  were  given  were  as  ideal  as  possible.    In  all,  6477 
usable  records  were  secured. 

The  scoring  was  done  by  two  trained  workers.^  After  cor- 
recting a  large  number  of  these  papers  a  key  was  formulated,^ 
which  contained  acceptable  answers,  common  non-acceptable 
answers,  etc.  All  the  papers  were  then  graded  according  to 
these  principles.  Since  the  test  had  been  so  well  scaled,  it  was 
practicable  to  give  one  point  for  each  correct  answer.  No  par- 
tial credits  were  allowed.  Each  pupil's  score  was  the  number 
of  questions  answered  correctly. 


'  One  was  the  author.    The  other  was  Miss  Marjorie  Meehan,  to  whom 
the  writer  is  extremely  indebted  for  her  painstaking  and  reliable  work. 
'  See  Appendix. 
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The  exact  procedure  as  outlined  by  McCall  for  T  scaling  was 
then  followed.  Papers  from  our  886  12-year-olds  were  sepa- 
rated from  the  others,  and  the  percentage  of  12-year-olds  pass- 
ing each  question  was  determined.  (See  Table  IV).  The 
percentage  of  12-year-olds  exceeding  plus  half  those  reaching 
0, 1,  2,  .  .  .  25  questions  was  then  computed.  From  these  per- 
centages the  scale  score  (in  S.D.  values)  was  determined 
from  the  table  furnished  by  McCall.^^^  Since  the  12-year 
ability  did  not  include  scores  as  low  as  necessary,  the  scale 
was  extended  at  the  lower  end  by  repeating  the  above  proc- 
esses for  question  0  in  the  case  of  10-year-olds.  Since  the 
scale  score  for  question  0  was  3  points  below  their  score  for 
question  1,  3  points  was  subtracted  from  the  18  shown  in  Table 
IV.  The  same  procedure  for  questions  22-25  was  followed 
with  16-year-olds. 

Table  IV 
T  SCALING  INFORMATION  A 


Total  No. 

No.  of 

%  Exceeding 

Questions 

12-yr.-olds 

+  Half  Those 

Scale 

Correct 

Pupils* 

Reaching 

Score 

0 

0 

15 

1 

1 

99.94 

18 

2 

1 

99.83 

21 

3 

6 

99.43 

25 

4 

2 

98.98 

27 

5 

8 

98.42 

29 

6 

15 

97.12 

31 

7 

29 

94.64 

34 

8 

37 

90.91 

37 

9 

49 

86.06 

39 

10 

69 

79.40 

42 

11 

92 

70.32 

45 

12 

96 

59.71 

48 

13 

108 

48.19 

60 

14 

113 

35.72 

54 

15 

83 

24.65 

57 

16 

62 

16.47 

60 

17 

45 

10.44 

63 

18 

30 

6.21 

65 

19 

19 

3.44 

68 

20 

12 

1.69 

71 

21 

9 

.51 

76 

22 

0 

79 

23 

0 

82 

24 

0 

85 

25 

0 

91 

*At  upper  level, 

above  first  line,  scale  score 

is  based  on  performance  of  lO-yr.-olds. 

At  lower  level,  bel 

ow  second  line,  it  is  based  on  performance  of  16-yT. 

-olds. 

"  53,  p.  279. 
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The  test  was  then  standardized  for  age  and  grade.  A  dis- 
cussion of  these  results  is  contained  in  the  ensuing  chapters. 

In  order  to  see  if  the  test  was  local  in  significance,  e.g.,  in 
some  way  favored  our  particular  group  of  children,  it  was 
tried  out  on  a  group  (106)  of  tenth  grade  children  in  Spring- 
field, Illinois,  and  71  tenth  graders  in  Portland,  Oregon.  In 
neither  case  were  the  new  groups  at  a  loss.  In  fact,  each 
group  did  somewhat  better  than  the  original.  This  seems  to 
rule  out  the  possibility  of  the  test's  being  very  localized  in 
import. 

It  was  necessary,  also,  to  measure  the  reliability  of  the 
test.  Since  it  was  found  impossible  to  give  the  test  twice 
and  no  duplicate  form  existed  we  correlated  the  separate 
scores  on  odd  and  even  questions,  and  calculated  the  reliability 

2rh^i 
of  the  whole  test  by  the  formula  rx  — - — ; — ^.  The  self  correla- 

1  +  rh 

tion  of  360  cases  chosen  at  random  from  all  grades  was  .83, 
P.E.Ol.  This  comes  within  the  range  of  minimum  reliability 
coefficients,  as  set  forth  by  Garrett.^^ 

Scaled  Information  A  is  now  in  daily  clinical  use  at  the 
Judge  Baker  Foundation,  Boston,  Mass.,  and  has  been  found 
satisfactory  as  a  test  of  practical  commonsense  information. 

Scaling  Information  A 

In  the  course  of  our  investigation,  it  became  necessary  to 
make  a  test  for  rural  children  as  Information  A  had  been 
constructed  for  urban  children.  As  far  as  we  know,  there  are 
no  precedents  for  this.  It  has  always  been  taken  for  granted 
that  tests  scaled  and  standardized  on  white  city  children 
should  be  made  the  basis  of  comparison  with  other  groups,  but 
seldom  indeed  have  the  tables  been  turned.  Velma  Helmer 
attempted  to  devise  tests  "to  demonstrate  the  possibility  of 
improving  the  Indians'  relative  score  at  verbal  tests  by  pre- 
senting situations  which  are  probably  more  familiar  to  the 
Indian"^^  than  those  found  in  standard  tests.  Reference  was 
m.ade  to  "hogun,"  "tepee,"  Indian  customs,  materials,  etc.  This 
obviously  favored  the  Indian  children.  No  such  attempt  has, 
to  our  knowledge,  previously  been  made  with  rural  children. 

Construction.     A  preliminary  test  of  80  questions,^^  was 


"51,  p.  271. 
"Ibid.,  p.  269. 
"  58,  p.  42. 
"  See  Appendix. 
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compiled  from  material  submitted  by  rural  teachers.  Thirty- 
seven  questions  were  identical  with  questions  in  the  prelimi- 
nary A  test.  As  in  the  case  of  the  former  test,  the  author 
framed  all  the  questions  and  included  none  which  appeared  to 
be  merely  local  in  significance,  or  highly  specialized.  These 
questions  were  given  to  all  the  children  in  an  entire  rural  dis- 
trict. This  covered  52  schools  and  included  416  children  from 
the  4th-12th  grades.  It  must  be  remembered  that  rural 
schools  consist,  in  great  part,  of  one-room  schools,  averaging 
10-25  pupils  from  all  grades.  The  distribution  of  cases  fol- 
lows: 


Table  V 

Grades 

IV 

V 

VI 

VII      VIII 

IX 

X 

XI 

XII 

No.  of  Cases 

49 

57 

68 

73           32 

60 

33 

29 

15 

The  tests  were  given  by  the  individual  teachers  as  before. 
The  exact  instructions  followed  may  be  found  in  the  appendix. 

From  the  returns,  the  percentage  of  correct  responses  for 
each  question  was  determined  (see  Table  VI)  in  the  way  al- 
ready described  in  the  previous  section  and  the  final  test  of 
25  questions  secured  in  the  same  manner  as  before.  It  is 
reproduced  below. 

Table  \T 
PRELIMINARY  SCALE  B 

Questions  Arranged  in  Order  of  Difficulty  for  Rural  Children 

% 


Passing 


.29 

99.8 

.84 

98.6 

.91 

98.3 

1.37 

95.0 

1.43 

94.3 

1.43 

94.3 

1.45 

94.1 

1.47 

93.9 

1.57 

93.5 

1.68 

90.8 

1.70 

90.5 

1.73 

89.9 

1.74 

89.9 

1.77 

89.1 

1.82 

88.2 

1.85 

87.7 

1.93 

85.9 

1.93 

85.9 

What  may  we  expect  when  we  see  heavy  black  clouds? 

How  many  cents  are  there  in  a  quarter.'' 

Of  what  is  butter  made.' 

How  much  does  it  cost  to  mail  a  letter  to  any  city  in  the  U.  S.? 

How  can  you  keep  milk  from  souring.'' 

At  what  time  of  year  do  many  leaves  turn  red? 

What  are  the  four  seasons? 

From  what  does  maple  sugar  come? 

What  is  our  national  song? 

How  many  states  are  there  in  the  U.  S.? 

Name  a  vegetable  that  grows  above  ground. 

How  many  pecks  are  there  in  a  bushel? 

^ATiat  kind  of  dairy  cow  gives  the  richest  milk? 

How  many  pints  are  there  in  a  quart? 

Name  the  young  of  the  sheep,  cow,  horse. 

Name  five  fruits. 

What  do  we  mix  with  ice  to  help  us  freeze  ice-cream  more  quickly? 

What  is  the  largest  city  in  the  U.  S.? 
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Who  was  the  first  President  of  the  U.  S.? 
What  is  the  capital  of  the  U.  S.? 
Name  four  dififerent  trees. 
Draw  a  square  and  an  oblong. 
How  old  must  you  be  before  you  can  vote? 
What  do  the  stars  in  the  American  flag  represent? 
Why  should  we  kill  flies? 
From  what  animal  do  we  get  mutton? 
Of  what  is  paper  made? 

Name  two  birds  that  stay  North  in  the  winter. 
Of  what  is  rubber  made? 

Why  does  seasoned  wood  burn  more  easily  than  green  wood? 
Why  are  crops  hoed? 
How  many  sides  has  a  triangle? 
Name  five  crops. 

What  holiday  do  we  celebrate  that  was  first  celebrated  by  the  Pil- 
grims? 

Who  is  the  Governor  of  your  State? 

What  is  the  shortest  month  in  the  year? 

What  tree  doesn't  shed  its  leaves  in  the  Fall? 

Why  is  it  necessary  to  limit  the  hunting  season? 

Tell  one  way  of  finding  out  the  age  of  a  tree. 

Why  don't  we  see  the  stars  in  the  daytime? 

Why  is  it  dark  at  night? 

What  kind  of  cloth  is  made  from  flax? 

Name  three  states  in  the  U.  S.  where  cotton  is  raised. 

Name  a  famous  American  inventor  and  tell  what  he  invented. 

How  many  weeks  are  there  in  a  year? 

What  is  a  submarine  boat? 

About  how  often  do  we  have  a  full  moon? 

What  artificial  waterway  connects  the  Atlantic  with  the  Pacific? 

Name  a  coimtry  in  Europe  which  is  a  Republic. 

What  is  the  correct  temperature  for  a  living  room? 

Name  five  wild  flowers. 

Where  does  Congress  meet? 

What  form  of  government  have  we  in  the  U.  S.? 

What  is  the  economic  value  of  Alaska  to  the  U.  S.? 

What  is  steam? 

Name  the  continents  in  order  of  size. 

Why  does  frost  form  on  the  inside  of  the  window  pane? 

Name  three  products  made  from  wheat. 

Name  two  animals  that  hibernate  in  winter. 

Name  three  uses  of  forests. 

What  is  the  highest  court  in  the  U.  S.  called? 

What  causes  an  eclipse  of  the  sun? 

Name  two  stones  used  for  building  purposes. 

Who  was  the  President  of  the  U.  S.  during  the  World  War? 

Give  one  reason  for  the  rotation  of  crops. 

How  do  sponges  grow? 

In  what  part  of  the  day  are  the  shadows  longest? 

Name  three  different  plants  from  which  sugar  is  made. 

In  what  month  of  the  year  do  the  days  begin  to  grow  shorter. 

Why  is  the  moon  light  at  night? 

Name  two  differences  between  the  barks  of  birch  and  oak  trees. 

How  can  you  locate  the  Pole  star? 


a    %  Passing 

2.00 

84.2 

2.01 

84.1 

2.01 

84.1 

2.02 

83.7 

2.03 

83.6 

2.03 

83.6 

2.08 

82.3 

2.08 

82.3 

2.09 

82.1 

2.11 

81.4 

2.15 

80.3 

2.16 

80.2 

2.17 

79.9 

2.23 

78.2 

2.25 

77.4 

2.29 

76.4 

2.30 

75.9 

2.38 

73.3 

2.42 

72.1 

2.46 

70.7 

2.47 

70.3 

2.60 

65.6 

2.61 

65.4 

2.61 

65.4 

2.62 

65.1 

2.64 

64.1 

2.65 

63.7 

2.71 

61.4 

2.73 

60.6 

2.75 

60.0 

2.80 

58.2 

2.82 

57.2 

2.84 

56.4 

2.88 

53.1 

2.89 

54.5 

2.92 

53.2 

2.94 

52.7 

2.95 

52.2 

3.01 

49.3 

3.06 

47.3 

3.08 

47.0 

3.08 

46.5 

3.11 

45.3 

3.11 

45.3 

3.11 

45.3 

3.17 

43.3 

3.28 

38.8 

3.32 

37.2 

3.39 

34.6 

3.42 

33.7 

3.72 

23.6 

3.84 

20.0 

3.87 

19.2 

4.20 

11.4 

Standardization.  This  test  was  then  administered  to  4875 
rural  children  from  eight  districts  sampling  Northern,  South- 
ern, Eastern,  Western  and  Central  sections  of  the  state.    The 
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map  outlines  the  districts  included  and  shows  how  adequately 
the  state  was  covered. 

The  tests  were  administered  as  before  under  precise  in- 
structions.^5  The  correcting  was  done  by  two  trained 
workers,^^  a  key  formulated/'^  and  the  tests  scored  as  before. 
The  self  correlation  was  found  to  be  .84,  P.E.Ol  (580  cases) 
for  grades  4-8  inclusive.  Norms  for  age,  grade,  sexes,  union 
and  one-room  schools  were  secured.  These  will  later  be  dis- 
cussed in  detail. 


Summary 

1.  Information  Test  A  was  constructed  for  clinical  use. 
It  was  tried  out  on  764  urban  children.  It  was  T  scaled  and 
standardized  on  the  entire  school  population  (6477)  of  one 
city.    The  test  was  found  to  be  statistically  reliable. 

2.  Information  Test  B  was  scaled  on  415  rural  children 


Districts  Included  in  Scaling  and 
Standardization  of  Scaled  Information  B, 


CA — Cayuga         J — Jefferson 
CH — Chatauqua    N — Niagara 
CHE— Chenango  ST.— St.  Lawrence 
D — Dutchess         W — ^Washington       / 


^^  See  Appendix. 

"  Again  the  author,  this  time  assisted  by  Miss  A.  Anastasi  who  is  to 
be  highly  commended  for  the  painstaking  care  with  which  she  accom- 
plished this  work. 

"  See  Appendix. 
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from  one  district  and  standardized  on  4875  rural  children 
from  eight  districts  in  one  state. 


SCALED  INFORMATION  TEST— B 


4. 
5. 
6. 

7. 

8. 

9. 

10. 

11. 
12. 
13. 
14. 
15. 
16. 
17. 
18. 
19. 
20. 
21. 
22. 
23. 
24. 
25. 


Age:  Yes.. 
Grade 


Of  what  is  butter  made.'' 

How  much  does  it  cost  to  mail  a  letter  to  any- 
city  in  the  U.  S.? 

What  are  the  four  seasons? 

What  is  our  national  song? 

Name  a  vegetable  that  grows  above  ground. 

Name  the  young  of  the  sheep,  cow,  horse. 

What  do  we  mix  with  ice  to  help  us  freeze  ice- 
cream more  quickly? 

Name  four  different  trees. 

From  what  animal  do  we  get  mutton? 

Why  does  seasoned  wood  bum  more  easily  than 
green  wood? 

Name  five  crops. 

What  tree  doesn't  shed  its  leaves  in  the  fall? 

Tell  one  way  of  finding  out  the  age  of  a  tree. 

Why  don't  we  see  the  stars  in  the  daytime? 

About  how  often  do  we  have  a  full  moon? 

Name  five  wild  flowers. 

What  is  the  economic  value  of  Alaska  to  the  U.  S.? 

Why  does  frost  form  on  the  inside  of  the  window  pane? 

Name  three  uses  of  forests. 

Who  was  the  President  of  the  U.  S.  during  the  World  War? 

Give  one  reason  for  the  rotation  of  crops. 

Name  three  different  plants  from  which  sugar  is  made. 

In  what  month  of  the  year  do  the  days  begin  to  grow  shorter? 
,  Why  is  the  moon  light  at  night? 
,  How  can  you  locate  the  Pole  star? 


.Mos.. 


CHAPTER  III 

Age  and  Sex  Differences 

The  previous  chapter  has  dealt  with  the  construction  and 
process  of  standardization  of  Tests  A  and  B.  In  this  and  the 
following  chapters  we  shall  consider  in  detail  the  results  of 
trying  these  tests  out  on  an  urban  and  rural  population. 

Age  and  Grade  Scores  on  Information  A.  Table  VII  shows 
the  grade  and  age  norms  of  the  urban  population  on  Test  A. 
These  norms  are  T  scaled,  so  that  50  (in  this  case  50.1)  is  the 
average  for  12-year-olds.  It  will  be  observed  that  the  averages 
increase  perceptibly  from  age  to  age  and  grade  to  grade. 


Table  VII 
SCALED  INFORMATION  A 

Urban  Scores 


No.  of 

No.  of 

Age 

Cases 
371 

Aver. 

42.2 

9.3 

Grade 

Cases 

Aver. 

ff 

9 

4 

970 

40.7 

9.0 

10 

768 

43.6 

9.3 

5 

988 

47.8 

9.0 

11 

883 

47.5 

9.3 

6 

955 

50.2 

9.0 

12 

886 

50.1 

10.0 

7 

932 

54.7 

8.1 

13 

952 

54.7 

10.1 

8 

822 

58.6 

7.9 

14 

838 

57.4 

9.3 

9 

638 

60.9 

7.8 

15 

614 

59.4 

9.1 

10 

505 

61.2 

8.1 

16 

530 

61.7 

8.8 

11 

389 

65.5 

8.5 

17 

325 

64.5 

10.4 

12 

278 

68.9 

9.1 

18 

198 

68.8 

8.6 

*College 

Freshmen 
93 

81.8 

5.2 

*College  Seniors 

69 

84.9 

5.3 

*These  are  not  included  in  the  age  groups. 

Table  VIII  shows  us  that  the  differences  between  consecutive 
ages  and  grades  are  entirely  reliable.    Conventional  reliability 


is  obtained  when 


Difference 


=r  3.  The 


Differences 


in  these  cases 


Sigma  "  ~"' ""''Sigma 
average  5.5  for  age,  and  8.0  for  grade.  We  may  say,  then, 
that  we  have  a  test  highly  discriminative  for  age  and  grade 
levels.  This,  of  course,  makes  it  very  useable  in  clinical  prac- 
tice. 

It  has  been  found  that  where  adequate  measures  are  used, 
the  rate  of  mental  growth  can  be  shown  to  be  fairly  uniform. 

19 
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Table  VIII 

SCALED  INFORMATION  A 

Reliability  of  Differences — Urban  Schools 

AGE 


Actual 

<r 

Difference 

Chances  that  true 

Years 

Difference 

Difference 

in  a  units 

diff.  is 

above  0 

9  &10 

1.4 

.59 

2.4 

99.2 

in  100 

lO&ll 

3.9 

.47 

8.3 

too 

in  100 

11  &12 

2.6 

.55 

5.5 

100 

in  100 

12&13 

4.6 

.48 

9.6 

100 

in  100 

13&14 

2.7 

.46 

5.9 

100 

in  100 

14&15 

2.0 

.49 

4.1 

100 

in  100 

15&16 

2.3 

.53 

4.3 

100 

in  100 

16&17 

2.8 

.69 

4.1 

100 

in  100 

17&18 

4.3 

.87 
GRADE 

4.9 

100 

in  100 

Grades 

4&5 

7.1 

.40 

17.8 

100 

in  100 

5&6 

2.4 

.40 

6.0 

100 

in  100 

6&7 

4.5 

.39 

11.2 

100 

in  100 

7&8 

3.9 

.39 

10.0 

100 

in  100 

8&9 

2.3 

.42 

5.5 

100 

in  100 

9&10 

.3 

.48 

.6 

74 

in  100 

lO&ll 

4.3 

.56 

7.7 

100 

in  100 

11  &12 

3.4 

.69 

4.9 

100 

in  100 

Brooks  (9),  for  example,  has  demonstrated  by  retests  of  chil- 
dren with  a  large  battery  of  tests  that  growth  is  very  nearly 
constant  from  9-15.  More  nearly  pertinent  to  our  own  find- 
ings is  that  of  Terman  (with  the  information  test  described  in 
Chapter  II),  who  reports  that  the  age  norms  "gave  an  ap- 
proximately straight  line  from  ages  8-15."^^  Weeks,  on  her 
vocabulary  information  test,  also  reports  that  "the  average 
of  grade  scores  showed  a  continuous  increase."^^ 

Besides  the  6,265  urban  children,  a  few  college  students 
were  tested.  Their  averages  are  included  in  Table  VII. 
While  the  test  was  obviously  too  easy  for  them,  still  it  did 
discriminate  between  the  Freshmen  and  Seniors.^o 


"  3,  p.  299. 

"5,  p.  62. 

^Dr.  R.  Brotemarkle  (of  the  University  of  Pennsylvania)  and  the 
author  have  prepared  an  information  test  overlapping  with  Test  A  to 
the  extent  of  five  questions,  the  other  20  being  scaled  in  a  similar  fash- 
ion for  college  students.  Dr.  Brotemarkle  has  used  this  scale  in  rather 
extensive  tests  of  college  students.  His  article,  with  results,  is  to  be 
published  shortly. 
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Graph  I  illustrates  the  regularity  and  consistency  of  the 
age  and  grade  norms.  Their  deviation  from  a  straight  line 
drawn  from  start  to  iinish  would  not  be  very  marked.  Also, 
the  norms  for  age  and  grade  are  unusually  consistent  in  re- 
gard to  each  other.  This  would  undoubtedly  be  more  often 
encountered  in  standardization  work  if  large  enough,  un- 
selected  samples  of  the  population  were  taken. 

Average 
Scores 


30 


20 


10 


Fig.  1.    Information  A.  Age  and  Grade  Scores 

Graph  II  shows  the  distribution  of  scores  for  sixth  grade 
children.  Its  close  approximation  to  the  curve  of  normal 
probability  is  evident,  and  once  more  points  to  the  value,  or, 
in  fact,  sheer  necessity,  for  accurate  standardization,  of  using 
a  large  number  of  cases. 

Age  and  Grade  Scores  on  Information  B 
Table  XVII    (in  chapter  IV)    shows  the  age  and  grade 
averages  on  Scaled  Information  B  for  boys  and  girls,  from 
one-room  and  union  schools.     The  age  averages  for  the  one- 
room  schools  progress  smoothly  and  consistently  until  age  15 
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Number 

of 

Cases 

190 


\hO 


IM) 


no 


100 


fe        8        lo       II       m.       lb       13 

Fig.  2.    Information  A.   Grade  VI.   Distribution 


Raw 
2.0  Scores 


when  there  is  a  slump.  This  is  readily  explainable.  The  one- 
room  schools  proceed  only  as  far  as  the  8th  grade.  At  this 
juncture,  pupils  have  to  change  to  Union  schools  for  the  com- 
pletion of  their  education.  Consequently  only  the  dullest 
children  will  be  left  in  the  one-room  schools  at  the  upper  ages. 

Graph  III  is  plotted  similarly  to  Graph  I.  While  there  is  a 
reasonably  consistent  straight  line  relationship,  the  age  and 
grade  norms,  however,  are  not  as  readily  superimposable  as 
in  Test  A.  This  is  probably  due  to  the  fact  that  grade  placings 
are  much  more  flexible  in  rural  schools.  When  25  children 
from  grades  2-8  are  gathered  together  in  one  school  room,  it 
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is  reasonable  to  conclude  that  their  grade  placings  will  be  less 
rigid  and  more  reliant  on  the  criteria  of  the  individual  teacher 
than  in  the  city  schools. 


Average 
Grades 

l^ 

...••••■ 

n 

15- 

••.  \ 

13 

-.A(?E 

1  •/ 

...(^RADE 

"/^ 

•• 

/ 

10        w 
Fig.  3 

AsTG 

•^         »3         llf.     and 
:SZ1        VIX      Slu.  Grade 

Information  B.   Age  and  Grade  Averages 

For  the  union  schools,  there  is  a  steady  increase  in  the 
norms  from  ages  9-18  except  for  the  age  13,  which,  for  the 
girls,  is  the  same  as  for  year  12.  This  is  not  true  of  the  boys' 
norms  for  those  years,  and  we  are  at  a  loss  to  explain  this  one 
inconsistency.    At  no  age,  however,  is  there  any  slump. 

As  far  as  the  grade  norms  go,  progression  from  4th  to  12th 
is  consistent  and  fairly  smooth  for  the  boys  and  also  for  the 
girls  with  one  exception  of  a  slight  slump  at  grade  12. 

Table  IX  shows  the  reliability  of  the  differences  from  age 
to  age  and  grade  to  grade.  They  are  not  as  marked  in  this 
test  as  in  Information  A.  However,  the  chances  for  a  true 
difference  average,  in  the  case  of  age,  93.9  for  one-room 
schools,  and  87.3  for  union  schools ;  in  the  case  of  grade,  96.5 
for  one-room  schools  and  92.7  for  union  schools.  These  are 
rather  significant  differences. 

Sex  Differences.  It  is  extremely  regrettable  that  when  the 
norms  for  Scaled  Information  A  were  compiled,  no  distinc- 
tion was  made  between  those  for  boys  and  girls.  There  was 
plenty  of  precedent  for  this  lumping  procedure.  For  exam- 
ple, in  all  the  Pintner  Paterson  norms  no  attention  is  paid  to 
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Table  IXa 

SCALED  INFORMATION  B 

RELIABILITY  OF  AGE  AND  GRADE  DIFFERENCES— 

ONE-ROOM  SCHOOLS 

BOYS 


Actual 

<r 

Difference 

Chances  that  true 

Years 

Difference 

Difference 

in  a  units 

diff.  is  above  0 

8&9 

2.44 

1.06 

2.30 

98.9  in  100 

9  &10 

.40 

.77 

.52 

69      in  100 

lO&ll 

1.08 

.46 

2.35 

99.2  in  100 

11  &  12 

1.94 

.41 

4.73 

100      in  100 

12&13 

.92 

.39 

2.36 

99.2  in  100 

13  &  14 

.82 

.36 

2.28 

98.9  in  100 

14&15 

.38 

.40 

.95 

83      in  100 

Grades 

3&4 

2.60 

.68 

3.82 

100      in  100 

4  &5 

3.22 

.32 

1.00 

84      in  100 

5&6 

2.08 

.30 

6.93 

100      in  100 

6&7 

1.44 

.30 

4.80 

100      in  100 

7&8 

1.40 

.30 
GIRLS 

4.67 

100      in  100 

Years 

8&9 

2.86 

1.01 

2.83 

100      in  100 

9&10 

.56 

.53 

1.06 

85      in  100 

10  &  11 

1.92 

.42 

4.57 

100      in  100 

11  &12 

.68 

.44 

1.55 

93.5  in  100 

12  &  13 

1.04 

.40 

2.60 

99.5  in  100 

13&14 

.94 

.41 

2.29 

98.9  in  100 

14&15 

.62 

.47 

1.32 

90      in  100 

Grades 

3&4 

.98 

.96 

1.02 

84      in  100 

4  &5 

3.04 

.35 

8.68 

100      in  100 

5&6 

2.06 

.37 

5.57 

100      in  100 

6&7 

2.00 

.35 

5.71 

100      in  100 

7&8 

.60 

.32 

1.88 

97      in  100 

sex  differences.  In  such  performance  tests,  where  boys  have 
so  often  been  shown  to  excel,  we  should  consider  such  a  pro- 
cedure exceedingly  dubious.  In  comparing  girls  the  averages 
are  probably  too  high,  for  the  boys,  too  low.  In  the  21  form- 
board  and  construction  tests  we  analyzed,  wherever  there  was 
sex  differentiation  (i.e.,  in  only  5  cases),  a  considerable  su- 
periority on  the  part  of  the  boys  was  consistently  found. 

As  far  as  verbal  tests  go,  however,  sex  differences  have  even 
more  rarely  been  taken  into  account.  Even  in  the  splendid 
standardization  of  the  Thorndike  McCall  scale,  so  adequate  as 
to  scaling  and  number  of  cases,  norms  are  not  given  for  boys 
and  girls  separately. 
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Table  IXb 
SCALED  INFORMATION  B 
RELIABILITY  OF  AGE  AND  GRADE  DIFFERENCES- 
UNION  SCHOOLS 
BOYS 


Actual 

c 

Difference 

Chances  that  true 

Years 

Difference 

Difference 

in  a  units 

diff.' 

is  above  0 

9&10 

2.70 

1.02 

2.65 

99. 

6  in  100 

10  &  11 

.82 

.69 

1.19 

88 

in  100 

11  &12 

1.26 

.60 

2.10 

98 

in  100 

12&13 

2.36 

.57 

4.14 

100 

in  100 

13&14 

.44 

.50 

.88 

82 

in  100 

14  &  15 

.64 

.42 

1.43 

92 

in  100 

15&16 

.40 

.43 

.93 

83 

in  100 

16&17 

.64 

.52 

1.23 

89 

in  100 

17  &18 

.90 

.52 

1.73 

96 

in  100 

Grades 

4&5 

3.20 

.49 

6.53 

100 

in  100 

5&6 

1.66 

.42 

3.95 

100 

in  100 

6&7 

1.30 

.45 

2.89 

100 

in  100 

7&8 

1.36 

.40 

3.40 

100 

in  100 

8&9 

.84 

.33 

2.55 

99. 

4  in  100 

9  &  10 

.80 

.37 

2.16 

98. 

3  in  100 

lO&ll 

.30 

.82 

.37 

64. 

5  in  100 

11  &  12 

.48 

.82 
GIRLS 

.59 

73 

in  100 

Years 

9&10 

.94 

.79 

1.19 

88 

in  100 

10  &  11 

1.58 

.59 

2.68 

99. 

6  in  100 

11  &  12 

1.74 

.59 

2.95 

99. 

8  in  100 

12&13 

0 

13&14 

1.36 

.47 

2.89 

99. 

8  in  100 

14  &15 

.90 

.48 

1.88 

96 

in  100 

15  &  16 

.46 

.50 

.92 

82 

in  100 

16&17 

1.12 

.45 

2.49 

99. 

4  in  100 

17  &  18 

.36 

.42 

.86 

80 

in  100 

Grades 

4&5 

3.24 

.42 

7.71 

100 

in  100 

5  &6 

2.68 

.40 

6.70 

100 

in  100 

6&7 

.12 

.42 

.29 

62 

in  100 

7&8 

1.34 

.41 

3.27 

100 

in  100 

8&9 

.90 

.35 

2.57 

99. 

5  in  100 

9  &  10 

.66 

.41 

1.61 

94 

in  100 

lO&ll 

1.12 

.42 

2.67 

99. 

6  in  100 

Whipple,  in  a  recent  article,  says :  "The  outcome  of  any  in- 
telligence test  may  be  regarded  as  conditioned  by  a  series  of 
factors,  such  as  age,  sex,  native  ability,  school  training,  prac- 
tice and  race.  Of  these  factors  comparatively  little  attention 
has  been  paid  to  sex,  perhaps  because  the  sex  difference  was 
regarded  as  of  little  magnitude  or  of  little  practical  import. 
In  the  classification  of  pupils,  for  example,  the  scores  of  either 
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sex  have  been,  doubtless  quite  properly  (italics  are  ours), 
compared  with  the  single  standard  score  for  the  age  or  grade 
in  question,  which  has  been  itself  derived  from  the  scores 
obtained  by  hundreds  of  children  of  both  sexes  combined,  to 
furnish  the  standard  age  score  or  the  standard  grade  score.''^^ 
Our  results  seem  to  cast  grave  doubt  on  that  "doubtless 
quite  properly."  For,  in  test  B„  the  norms  are  carefully  dif- 
ferentiated as  to  sex  for  both  urban  and  rural  children,  and 
the  results  are  remarkably  clear  cut.  Graphs  V-VII  show 
that  for  grades  4-7--  the  dotted  line  representing  the  girls' 
averages  runs  below  and  practically  parallel  to  the  continuous 


Table  X 

COMPARISON  BETWEEN  BOYS  AND  GIRLS— Information  B 

Reliability  of  Differences — One-Room  Schools 


Actual 

<T 

Difference 

Chances  that  true 

Years 

Difference 

Difference 

in  a  units 

diff 

is  above  0 

(Favor  of  Boys) 

8 

1.10 

1.20 

.92 

82 

n  100 

9 

.68 

.84 

.81 

79 

nlOO 

10 

.52 

.42 

1.24 

89 

n  100 

11 

-.32 

.46 

-.70 

76 

n  100  (Girls) 

12 

.94 

.39 

2.41 

99.2 

n  100 

13 

.82 

.40 

2.05 

98 

n  100 

14 

.70 

.37 

1.89 

97 

n  100 

15 

.46 

.49 

.94 

83 

n  100 

16 

.42 

.68 

.62 

73 

nlOO 

Grades 

3 

-.92 

1.12 

-.82 

79 

m  100  (Girls) 

4 

.72 

.35 

2.06 

98 

m  100 

5 

.88 

.32 

2.75 

99.7 

mlOO 

6 

.90 

.30 

3.00 

100 

m  100 

7 

.34 

.28 

1.21 

88 

m  100 

8 

1.14 

.33 

3.45 

100 

m  100 

Reliability  of  Differences- 

-Union  Schools 

Years 

9 

-.68 

1.10 

-.62 

73 

m  100  (Girls) 

10 

1.18 

.69 

1.61 

94 

m  100 

11 

.42 

.61 

.69 

76 

m  100 

12 

-.06 

.59 

-.10 

54 

m  100  (Girls) 

13 

2.30 

.51 

4.50 

100 

mlOO 

14 

1.38 

.46 

3.00 

100 

m  100 

15 

1.08 

.45 

2.40 

99.2 

m  100 

16 

1.02 

.49 

2.08 

98 

m  100 

17 

.54 

.48 

1.13 

87 

in  100 

18 

1.08 

.47 

2.30 

98.9 

m  100 

"  18,  p.  111. 

'^  Only  these  grades  were  included  in  order  to  allow  a  comparison  with 
the  urban  group,  where  only  grades  4-7  were  tested. 
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line,  representing  the  boys'  averages.  At  no  place  do  these 
two  lines  cross.  When  we  examine  Tables  X  and  XI,  how- 
ever, it  appears,  at  first  sight,  that  the  difference  is  not  en- 
tirely consistently  in  favor  of  the  boys.  For  the  one-room 
schools,  the  11-year  girls  and  the  third  grade  girls  exceed  the 
boys.    For  the  union  schools,  the  9-  and  12-year  girls  exceed 

,,     ,            rT^^                    Difference  .     ,,  -,-/»/,,-. 

the  boys.    The  average  ^i n—  m  these  cases  is  .56   (71 

chances  in  100  for  a  true  difference),  which,  of  course,  is 
very  low.  The  other  differences  are  in  favor  of  the  boys,  the 
average  number  of  chances  in  100  for  a  true  difference  being 
91.2  for  one-room  schools  and  94.2  for  union  schools.  For  the 
urban  group,  the  difference  is  consistently  in  favor  of  the  boys 
and  the  average  number  of  chances  in  100  for  a  true  differ- 
ence is  94.5. 

Table  XI 

COMPARISON  BETWEEN  BOYS  AND  GIRLS  (2)— Information  B 

Reliability  of  Differences — Union  Schools 


Actual 

<T 

Difference 

Chances  that  true 

Grades 

Difference 

Difference 

in  (X  units 

diff.- 

is  above  0 

(Favor  of  Boys) 

4 

.82 

.51 

1.61 

94 

in  100 

5 

1.28 

.40 

3.20 

100 

in  100 

6 

.26 

.42 

.62 

73 

in  100 

7 

1.44 

.45 

3.20 

100 

in  100 

8 

1.46 

.36 

4.06 

100 

in  100 

9 

1.40 

.32 

4.38 

100 

in  100 

10 

1.54 

.46 

3.35 

100 

in  100 

11 

.72 

.80 

.90 

82 

in  100 

12 

1.36 

.48 

2.83 

99. 

7  in  100 

Reliability  of  Differences- 

-Urban  Schools 

Years 

9 

1.18 

.98 

1.20 

88 

in  100 

10 

.88 

.49 

1.80 

96 

in  100 

11 

1.10 

.57 

1.93 

97 

in  100 

12 

1.28 

.53 

2.42 

99. 

2  in  100 

13 

1.34 

.76 

1.76 

96 

in  100 

Grades 

4 

.80 

.40 

2.00 

98 

in  100 

5 

.98 

.51 

1.92 

97 

in  100 

6 

1.74 

.47 

3.70 

100 

in  100 

7 

.46 

.58 

.79 

79 

in  100 

The  11-  and  12-year  divergence  of  the  norms  is  not  surpris- 
ing. It  has  been  found  often  that  around  or  just  before  the 
period  of  adolescence,  the  balance  is  turned  in  favor  of  one 
sex  for  a  time,  although  merely  temporarily.  The  third  grade 
and   9-year   divergence   may   perhaps   be   explained   on   the 
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grounds  of  the  paucity  of  cases.  We  had  only  38  boys  and  24 
girls  of  the  third  grade  from  one-room  schools  and  20  boys 
and  33  girls  from  the  union  schools.  This  is  the  only  place 
where  we  have  any  small  number  of  cases,  and,  under  no 
conditions,  as  we  have  often  emphasized,  can  such  numbers 
give  positively  reliable  results.  So,  we  may  fairly  conclude 
that,  with  the  possibility  of  an  exception  for  a  short  pre-ado- 
lescent  period,  our  boys  are  consistently  superior  to  our  girls. 

There  is  no  reason  to  believe,  moreover,  that  the  content 
of  the  test  particularly  favored  the  boys.  There  were  even  a 
few  more  girls  than  boys  in  the  original  group  on  which  the 
test  was  scaled.  Table  XII  shows  the  comparison  of  100  boys 
and  110  girls  from  District  A  on  test  B.  By  a  strange  coinci- 
dence, the  girls  exceed  in  12  questions,  the  boys  in  12  ques- 
tions, there  being  an  equal  score  on  the  first  question.  The 
average  percentage  by  which  the  boys  exceed  the  girls  is 
8.8%,  while  that  of  the  girls  exceeding  the  boys  is  6.3%. 
These  figures  account  for  the  age  and  grade  superiority  of 
the  boys.  It  doesn't  seem,  however,  that  with  the  questions 
roughly  stacking  as  we  have  indicated  above  there  could  have 
been  any  great  selection  in  favor  of  the  boys  except  in  so  far 
as  a  random  group  of  information  questions  would  always 
tend  to  favor  them.  Our  results  seem  to  indicate  a  genuine 
sex  difference. 

For  a  detailed  analysis  of  the  great  mass  of  contributions 
to  the  study  of  sex  differences,  the  reader  is  referred  to  the 
elaborate  summaries  so  carefully  compiled,  at  frequent  inter- 
vals,  by   such   authorities   as   Woolley    (20),    Hollingworth 


Tabub  XII 
QUESTIONS  FAVORING  EACH  SEX— Information  B 


%  in  Boys'     %  in  Girls' 
Question  Favor  Favor 


%  in  Boys'     %  in  Girls' 
Question  Favor  Favor 


1 

0 

0 

14 

18 

2 

2 

15 

6 

3 

8 

16 

10 

4 

19 

17 

6 

5 

8 

18 

6 

6 

2 

19 

5 

7 

7 

20 

10 

8 

3 

21 

3 

9 

3 

22 

8 

10 

11 

23 

9 

11 

7 

24 

7 

12 

6 

25 

1 

13 

15 
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(12,  13),  Goodenough  (10),  etc.  Lincoln  (15)  has  lately  con- 
tributed an  entire  book  on  this  subject. 

Goodenough,  comparing  recent  studies  says,  "The  most  out- 
standing impression  which  one  gains  ...  is  the  inconsistency 
of  the  various  findings."-^  In  the  field  of  general  information, 
however,  there  is  some  agreement,  and  it  is  gratifying  to  dis- 
cover that  our  results  are  confirmed  by  those  of  several  other 
investigators,  whose  work  is  summed  up  below: 

The  Berlin  Child  Study  Association  (17),  studying  2,238 
children  just  entering  school,  found  that  the  number  of  con- 
cepts grasped  by  the  boys  exceeded  that  of  the  girls.  Hall  (11) , 
in  his  study  on  Boston  children,  also  found  this  to  be  true. 

Pressey,  testing  2,544  school  children,  finds  that  the  "boys 
show  a  superior  ability  on  the  arithmetic  test  and  a  slightly 
higher  average  on  the  test  for  practical  information. "^4 
^  King  and  McRory  (14),  testing  Freshmen  with  Whipple's 
Range  of  Information,  found  that  61.6%  of  the  boys  reached 
the  median  of  the  girls. 

Terman,  in  his  study  of  gifted  children,  found  that  the 
"gifted  boys  excel  gifted  girls  in  general  information,  arith- 
metic and  spelling."-^ 

Book  and  Meadows  (7),  testing  2,422  boys  and  3,503  girls 
(all  H.  S.  seniors)  with  the  Pressey  Mental  Survey  Scale, 
found  that  the  boys  were  slightly  superior  to  the  girls  on  the 
whole  test.  The  tests  in  which  the  boys  most  exceeded  the 
girls  were  those  in  arithmetical  ability  and  practical  informa- 
tion. In  commenting  on  the  fact  that  Mrs.  Pressey,  testing 
subjects  9-15,  found  girls  somewhat  superior  on  the  test  as  a 
whole,  Book  and  Meadows  say:  "The  superior  rating  of  the 
girls  is  clearly  due  to  the  fact  that  the  girls'  development  is 
accelerated  from  1  to  2  years  during  this  period. "^^  It  is  in- 
teresting that  the  four  cases  in  our  own  results  where  the  girls 
excel  the  boys  are  12  years  or  below,  and  in  the  12-year  group 
there  is  practically  equality. 

.  Goodenough,  surveying  the  literature,  says :  "The  weight  of 
the  evidence,  therefore,  seems  to  point  to  the  conclusion  that 
boys  have  acquired  a  truly  wider  range  of  general  information 
than  have  girls  by  the  time  they  arrive  at  the  beginning  of  the 
grammar  school  period."-'^ 


""10,  p.  441. 
'■*  16,  p.  333. 
''  3,  p.  306. 
""  7,  p.  77. 
"  10,  p.  453. 
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Eastman  used  an  information  test  of  100  questions  with 
juvenile  delinquents.  She  finds  the  boys  superior  to  the  girls. 
"It  may  be  presumed  that  boys,  being  less  restricted  in  their 
freedom  on  city  streets,  acquire  a  more  extensive  knowledge 
of  their  immediate  environment."^^ 

This  falls  in  line  with  our  own  findings.'  It  is  true  that  most 
of  our  children  didn't  have  city  streets  to  roam,  but  it  is  true 
in  the  country  as  in  the  city  that  the  boys  have  greater  free- 
dom than  the  girls.  They  are  constantly  out  and  doing,  rub- 
bing elbows  with  newcomers,  and  gathering  bits  of  informa- 
tion from  sundry  sources,  whereas  the  girls  are  kept  indoors 
to  a  considerable  extent,  with  domestic  duties,  etc.  We  are 
not  surprised,  then,  to  find  that  the  boys'  range  of  informa- 
tion is  wider  and  more  inclusive  than  that  of  the  girls.^^ 

■■■A 

Summary 

1.  Information  A  was  found  to  be  highly  discriminative  for 
age  and  grade.  The  sigmas  of  the  difference  averaged  5.5  for 
age  and  8.0  for  grade. 

2.  Information  B  was  found  to  be  highly  discriminative  for 
age  and  grade  up  to  age  15.  An  explanation  for  the  appar- 
ent discrepancy  at  the  upper  ages  is  offered  in  the  text. 

3.  The  distribution  of  scores  was  found  to  resemble  closely 
that  of  the  curve  of  normal  probability. 

4.  The  various  graphs  illustrate  the  consistency  and  relia- 
bility of  our  norms  and  distributions.  This  is  believed  to  be 
due  to  the  use  of  large  numbers  and  adequate  statistical  pro- 
cedure.   This  is  urged  as  a  requisite  for  all  standardizations. 

5.  A  clear  cut  sex  difference  favoring  the  boys  was  demon- 
strated. 

6.  Minute  analysis  of  210  papers  of  boys  and  girls  led  to 
the  conclusion  that  the  content  of  the  test  did  not  unduly 
favor  the  boys. 

7.  A  review  of  the  pertinent  literature  shows  that,  on  the 
whole,  our  results  are  in  line  with  those  of  other  investigators. 

8.  We  urge  that  all  norms  be  sex  differentiated  when  used 
for  individual  appraisement. 


^i,  p.  208. 

^  In  view  of  the  fact  that  the  New  York  rural  survey  showed  the  boys 
to  be  considerably  more  retarded  than  the  girls,  this  sex  difference  in 
information  is  particularly  interesting.  The  rural  schools  are  probably 
better  adapted  to  the  girl  than  to  the  boy.  Most  of  the  one-room  schools, 
at  least,  are  taught  by  women  who  tend  naturally  to  stress  female  oc- 
cupations. 


CHAPTER  IV. 

Differences  Between  Various  Rural  Schools 

The  4875  rural  children  who  acted  as  subjects  in  our  final 
B  test  were  recruited  from  eight  districts  as  shown  on  the 
map  in  Chapter  III.  In  all,  approximately  300  schools,  one- 
room  and  union,  were  reached.  This  included  2330  children 
in  one-room  schools,  1808  from  union  schools,  and  737  un- 
classified. 

The  one-room  school  "is  that  institution  of  the  open  coun- 
try employing  a  single  teacher  and  providing  elementary  edu- 
cation (i.e.,  up  to  8th  grade  only)  for  the  children  in  the  area 
in  which  it  is  located. "^^  The  average  number  of  children  in 
each  school  is  approximately  25. 

According  to  the  government  report  on  consolidated  schools, 
the  typical  union  school  "is  the  result  of  uniting  five  districts 
or  schools  and  abandoning  four  schoolhouses.  ...  It  serves  an 
area  of  36  square  miles.  .  .  .  The  school  is  organized  on  the 
8-4  plan,  enrolling  204  children  in  the  elementary  grades,  76  in 
the  high  school.  .  .  .  The  teaching  staff  of  11  persons,  includ- 
ing the  superintendent,  is  divided  on  a  basis  of  six  or  seven  in 
the  elementary  grades  and  five  or  four  in  the  high  school.  .  .  . 
It  transports  110  (43%)  of  the  children  enrolled  an  average 
of  4.7  miles  one  way  in  35  minutes. "^^ 

This  chapter  deals  with  two  kinds  of  comparison,  i.e.,  1.  be- 
tween the  various  localities  tested ;  2.  between  the  two  types 
of  schools — one-room  and  union. 

Comparison  Between  Rural  Schools  in  Different 

Districts 
Tables  XIII-XVI  show  the  age  and  grade  averages  for  the 
one-room  and  union  schools  in  each  separate  district.  The 
averages  are,  of  course,  not  very  reliable  because  they  are 
necessarily  based  on  such  small  numbers.  For  example,  few 
one-room  schools  have  more  than  two  or  three  children  at 
the  upper  grades,  so  that  when  one  has  canvassed  all  the 
schools  in  the  district,  the  cases  for  each  grade  are  still  ex- 
tremely limited. 


26,  p.  339. 
21,  pp.  4-5. 
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Bearing  this  in  mind,  I  think  an  inspection  of  the  tables 
will  reveal  that  there  are  no  marked  and  consistent  differences 
between  the  eight  localities.  Such  variations  as  there  are  may 
doubtless  be  laid  to  the  small  numbers  of  cases.  No  district 
can  be  said  to  be  consistently  better  than  any  other.  The  av- 
erages cross  and  re-cross  each  other  and  often  end  up  the 
same.  For  example,  taking  12-year  one-room  girls,  there  is  a 
difference  of  only  .58  between  the  highest  and  lowest  average 
in  the  seven  districts.  This  is  confessedly  one  of  the  cases 
where  the  districts  do  stand  together  most  closely.  However, 
although  at  any  particular  age  or  grade  one  locality  may  seem 
to  be  considerably  above  another,  still  it  is  always  true  that 
at  some  other  point  it  falls  below.  The  averages  for  each  dis- 
trict, on  the  other  hand,  become  consistently  higher  with  age 
increase  and  grade  progress. 

In  our  study,  we  have  included  schools  as  far  west  and  as 
far  east  as  possible,  and  very  near  the  northern  and  south- 
ern boundary  lines.  (There  is,  in  some  cases,  more  distance 
between  two  rural  districts  than  between  any  rural  and  urban 
location).  We  have  found  no  clear  cut  differences  between 
the  various  districts  studied.  We  may  conclude,  then,  that 
our  tests  do  not  tap  information  indigenous  to  one  particular 
locality. 

This  is  an  extremely  important  point  to  ascertain.  When, 
as  is  sometimes  the  case,  tests  are  scaled  and  standardized 
on  children  in  one  locality  only,  it  is  doubtful  if  reliable  group 
comparisons  can  be  made  with  another  locality.  Here  again 
the  original  norm  material  must  be  carefully  scrutinized. 

Differences  Between  One-Room  and  Union  Schools. — A  gen- 
eral description  of  the  nature  of  one-room  and  union  schools 
has  been  given  above.  The  Census  Bureau  has  estimated  that 
at  the  end  of  1922  there  were  175,000  one-teacher  and  13,000 
consolidated  schools  in  the  United  States.  The  consolidated 
schools  are,  of  course,  constantly  on  the  increase. 

All  of  our  638  high  school  subjects  and  1170  of  our  grade 
school  children  were  recruited  from  union  schools.  We  have 
treated  results  from  the  two  types  of  schools  separately  in  all 
cases.  Table  XVII  shows  the  age  and  grade  averages  for  boys 
and  girls  in  the  union  schools  and  the  one-room  schools.  Scores 
from  all  union  schools  and  all  one-room  schools  respectively 
have  been  combined  in  this  table. 
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Table  XIII 
SCALED  INFORMATION  B 
AGE  SCORES  IN  ONE-ROOM  RURAL  SCHOOLS 


School  District  A 

School  District  B 

School  District  C 

Age 

No.  of 

No.   of 

No.  of 

&  Sex 

Cases 

Aver. 

a 

Cases 

Aver. 

a 

Cases 

Aver. 

a 

9B 

9 

10.56 

4.20 

6 

11.34 

2.92 

10 

11.80 

5.30 

0 

8 

9.24 

3.66 

10 

12.20 

4.84 

15 

10.74 

3.50 

10  B 

17 

11.58 

3.06 

17 

12.30 

3.94 

33 

12.10 

4.52 

0 

17 

11.94 

2.58 

33 

11.84 

4.18 

31 

11.46 

3.50 

11  B 

28 

14.50 

3.54 

24 

12.66 

3.74 

25 

14.76 

4.00 

G 

22 

14.64 

3.60 

21 

12.62 

4.16 

20 

13.50 

4.10 

UB 

31 

13.26 

4.24 

33 

15.54 

4.06 

32 

14.44 

4.04 

G 

41 

14.76 

4.16 

37 

14.18 

4.20 

29 

14.58 

4.68 

13  5 

43 

16.22 

3.34 

25 

16.68 

3.32 

31 

15.32 

4.60 

G 

20 

15.60 

4.24 

28 

16.28 

3.26 

27 

15.96 

3.78 

14  5 

23 

18.48 

2.78 

29 

16.94 

4.12 

29 

15.90 

3.82 

G 

20 

17.10 

3.32 

21 

16.42 

2.04 

20 

15.50 

3.94 

15  B 

24 

17.34 

3.30 

13 

17.16 

3.46 

22 

15.72 

4.80 

G 

17 

16.88 

2.88 

18 

16.78 

3.20 

9 

17.66 

3.12 

16  B 

5 

8 

17.50 

4.10 

12 

14.84 

4.36 

G 

11 

16.64 

3.16 

9 

17.44 

3.24 

4 

School  District  D 

School  District  E 

School  District  F 

9B 

6 

13.34 

2.12 

5 

5 

15.00 

3.58 

G 

10 

12.20 

3.70 

10 

12.40 

2.54 

13 

11.00 

2.94 

10  B 

24 

13.92 

3.38 

19 

11.74 

3.80 

30 

12.46 

4.22 

G 

18 

13.56 

4.52 

30 

11.06 

3.16 

46 

11.78 

3.54 

11  B 

21 

13.28 

3.96 

28 

13.22 

5.22 

42 

13.24 

3.16 

G 

21 

14.80 

4.62 

27 

13.74 

3.60 

56 

13.42 

4.32 

12  5 

31 

16.10 

4.56 

33 

15.18 

3.42 

67 

16.14 

3.92 

G 

22 

14.64 

4.20 

40 

14.24 

4.56 

60 

14.36 

4.46 

13  B 

16 

17.88 

3.08 

36 

17.28 

3.60 

56 

15.96 

4.68 

G 

12 

16.34 

3.08 

36 

14.56 

3.78 

51 

15.32 

4.20 

14  B 

20 

18.10 

3.44 

22 

18.10 

3.06 

49 

16.60 

4.26 

G 

17 

18.42 

2.56 

18 

15.00 

4.16 

37 

16.24 

3.62 

15  B 

18 

18.56 

2.94 

22 

18.82 

2.96 

32 

17.88 

3.28 

G 

10 

17.20 

4.60 

15 

17.26 

3.34 

14 

16.86 

3.24 

16  B 

5 

16.60 

1.96 

14 

17.86 

2.60 

8 

18.24 

2.82 

0 

2 

12 

16.00 

3.16 

8 

15.76 

3.86 

Age 


School  G* 


10  B 

11  B 


12.10 
18.40 


4.12 
3.24 


11 
10 


*In  this  school,  the  numbers  were  so  small  that  only  at  two  ages  was  it  possible  to 
compute  averages. 
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Table  XIV 

SCALED  INFORMATION  B 

GRADE  SCORES  IN  ONE-ROOM  RURAL  SCHOOLS 


School  A 

School  B 

School  C 

Grade 
and  Sex 

No.  of 
Cases 

Aver. 

a 

No.  of 
Cases 

Aver. 

a 

No.  of 
Cases 

Cases 

a 

3  B 
G 

3 
3 

4  B 
G 

65 

28 

11.90 
10.72 

3.74 
3.46 

35 

37 

10.88 
11.06 

4.38 
4.48 

50 

47 

10.16 
9.90 

4.28 
3.30 

5  B 
G 

41 
38 

14.66 

12.78 

3.18 
3.54 

34 

26 

14.18 
12.84 

2.92 
3.38 

33 
37 

13.12 
13.86 

3.28 
2.66 

6  B 
G 

27 
45 

16.70 
15.26 

2.44 
3.00 

34 
23 

16.36 
15.60 

3.34 

2.82 

56 
33 

15.36 
15.48 

3.34 
3.34 

7  B 
G 

25 
30 

18.84 
18.26 

2.64 
2.66 

37 
31 

18.02 
17.46 

3.00 
2.00 

36 
30 

16.94 
17.40 

3.10 
3.16 

8  B 
G 

22 
13 

18.90 
19.46 

3.04 

2.38 

16 
24 

18.00 
17.76 

3.44 
3.00 

24 
11 

19.00 
18.64 

2.52 

2.82 

School  D 

School  E 

School  F 

3  B 
G 

32 

18 

8.68 
8.56 

4.00 
4.70 

38 
70 

10.64 
10.20 

4.40 
3.70 

46 
58 

10.92 
9.62 

4.10 
3.60 

4  B 
G 

32 
34 

12.00 
11.00 

2.96 
4.34 

43 

28 

13.98 
13.86 

3.20 
2.06 

78 
65 

14.36 
12.66 

3.12 
3.92 

5  B 
G 

26 
18 

14.92 
15.34 

2.70 
3.00 

42 
51 

17.28 
15.32 

3.08 
2.76 

55 
55 

15.76 
15.00 

3.74 
2.40 

6  B 
G 

26 
25 

17.00 
16.76 

3.88 
3.22 

36 
29 

18.94 
17.20 

2.06 
3.12 

67 
65 

17.02 
16.88 

3.42 
2.90 

7  B 
G 

34 
15 

18.06 

17.80 

3.18 
3.00 

25 

22 

18.92 

17.72 

3.18 

2.72 

51 
35 

19.90 
17.98 

2.70 

2.84 

8  B 
G 

20 
18 

19.40 
17 .  22 

2.06 

2.82 

Gr. 

School  G* 

4  5  9.72       4.26        14 

5  B  14.84       2.52        12 
7  B  16.78       4.26  9 


*In  this  school,  the  numbers  in  each  grade  were  so  small  that  only  at  three  grades  was 
it  possible  to  compute  averages. 
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Table  XV 

SCALED  INFORMATION  B 

AGE  SCORES  IN  UNION  RURAL  SCHOOLS 


School  A 

School  D 

School  E 

Age 

No.  of 

No.  of 

No.  of 

and  Sex 

Cases 

Aver. 

a 

Cases 

Aver. 

a 

Cases 

Aver. 

a 

9  B 

1 

4 

11 

10.46 

3.68 

G 

5 

3 

13 

11.30 

3.90 

10  B 

8 

9.26 

4.30 

10 

16.20 

1.84 

18 

14.12 

3.22 

G 

12 

12.16 

4.20 

9 

13.00 

3.76 

24 

11.76 

3.26 

11  B 

17 

12.18 

3.82 

6 

29 

14.72 

3.82 

G 

15 

12.60 

3.78 

6 

36 

13.22 

4.18 

12  B 

14 

15.14 

5.78 

14 

14.72 

4.14 

37 

15.12 

4.44 

G 

19 

15.10 

4.28 

5 

28 

14.72 

3.92 

13  B 

18 

17.00 

3.26 

6 

18 

18.44 

3.38 

G 

20 

14.90 

3.38 

5 

30 

14.66 

4.14 

14  B 

17 

18.18 

4.56 

8 

19.00 

1.74 

39 

17.00 

3.90 

G 

31 

16.38 

4.58 

13 

17.62 

3.18 

38 

16.78 

3.18 

15  B 

23 

18.14 

3.00 

14 

20.58 

1.88 

19 

17.74 

2.26 

G 

14 

18.86 

4.50 

11 

16.82 

2.88 

26 

17.08 

4.70 

16  B 

17 

19.12 

2.88 

12 

19.66 

3.92 

33 

19.00 

3.54 

G 

16 

18.12 

3.32 

15 

19.40 

2.22 

20 

17.60 

3.16 

17  B 

9 

20.56 

2.64 

11 

21.36 

2.94 

14 

18.14 

3.52 

G 

10 

18.40 

2.00 

13 

20.08 

1.86 

16 

17.38 

2.84 

18  B 

9 

20.34 

2.30 

15 

21.14 

2.96 

20 

20.06 

2.42 

G 

8 

21.26 

2.10 

14 

20.72 

1.48 

18 

19.00 

3.12 

School  F 

School  G 

School  H* 

8  B 

19 

5.42 

3.46 

G 

28 

4.58 

3.44 

9  B 

3 

1 

34 

6.24 

4.20 

G 

9 

12.56 

4.20 

3 

40 

7.90 

4.34 

10  B 

12 

11.84 

3.32 

5 

42 

9.72 

5.18 

G 

30 

12.54 

2.01 

10 

12.60 

3.56 

46 

8.86 

4.14 

11  B 

22 

14.28 

3.80 

18 

15.66 

4.10 

29 

12.72 

3.96 

G 

29 

14.38 

4.20 

8 

16.00 

3.00 

40 

14.04 

3.84 

12  B 

24 

16.74 

4.44 

24 

15.92 

3.40 

39 

12.94 

5.78 

G 

43 

16.40 

4.02 

8 

15.50 

3.58 

53 

14.70 

4.94 

IS  B 

30 

17.40 

3.60 

20 

18.70 

3.96 

52 

16.24 

3.92 

Gf 

32 

16.68 

3.24 

18 

15.88 

3.34 

46 

16.44 

3.06 

14  B 

39 

19.16 

3.32 

24 

19.08 

2.98 

42 

16.48 

3.78 

G 

49 

17.82 

3.30 

14 

15.56 

4.68 

27 

18.18 

3.18 

IS  B 

39 

19.30 

2.38 

27 

19.30 

4.00 

37 

16.40 

5.50 

G 

41 

18.32 

2.92 

20 

18.00 

3.54 

50 

17.64 

3.50 

16  5 

23 

18.92 

2.92 

11 

21.54 

3.42 

35 

18.36 

2.28 

G 

30 

18.40 

3.24 

13 

18.54 

4.38 

22 

17.82 

3.06 

17  B 

34 

20.58 

3.56 

6 

16 

20.38 

2.20 

G 

35 

20.14 

2.04 

16 

20.38 

3.06 

16 

18.38 

2.98 

18  B 

9 

21.88 

1.92 

5 

G 

25 

19.48 

2.28 

4 
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Table  XVI 

SCALED  INFORMATION  B 

GRADE  SCORES  IN  UNION  RURAL  SCHOOLS 


School  A 

School  D 

School  E 

No.  of 

No.  of 

No.  of 

Grade 

Cases 

Aver. 

a 

Cases 

Aver, 

a 

Cases 

Aver. 

a 

4  B 

24 

10.26 

3.78 

9 

12.56 

3.10 

42 

10.86 

3.74 

G 

29 

9.68 

3.42 

15 

12.46 

2.96 

45 

10.46 

3.60 

5  B 

17 

13.82 

3.42 

17 

15.24 

3.36 

35 

14.88 

2.52 

G 

26 

13.62 

3.34 

6 

36 

12.72 

2.54 

6  B 

20 

16.30 

4.02 

8 

17.00 

3.00 

36 

16.06 

2.68 

G 

24 

16.42 

3.02 

4 

26 

15.54 

2.80 

7  B 

13 

17.00 

2.34 

7 

18.14 

1.82 

30 

17.40 

3.62 

G 

14 

15.86 

2.60 

13 

17.92 

2.44 

37 

15.64 

3.38 

8  B 

17 

18.88 

3.02 

4 

41 

18.96 

2.74 

G 

18 

17.44 

2.76 

36 

17.62 

3.00 

9  B 

23 

19.60 

2.72 

15 

21.40 

1.50 

18 

20.12 

2.24 

G 

18 

19.22 

3.12 

20 

27.70 

2.92 

32 

18.68 

2.42 

10  B 

9 

19.22 

1.98 

17 

20.30 

3.06 

16 

20.76 

2.98 

G 

5 

19.80 

2.04 

14 

18.86 

2.44 

15 

17.40 

3.36 

11  B 

9 

21.88 

2.34 

6 

8 

19.50 

1.94 

G 

15 

20.74 

1.90 

20 

20.90 

1.48 

7 

19.56 

1.40 

12  B 

6 

21.34 

1.38 

17 

21.82 

2.38 

12 

21.50 

1.20 

G 

7 

21.58 

2.06 

13 

19.78 

1.68 

12 

19.84 

3.20 

School  F 

School  G 

School  H* 

4  B 

25 

11.56 

2.74 

4 

52 

11.84 

4.32 

G 

22 

9.00 

2.82 

6 

53 

11.04 

3.40 

5  B 

27 

15.14 

3.26 

25 

14.84 

3.48 

56 

13.60 

4.02 

G 

35 

14.60 

3.12 

16 

12.74 

2.98 

59 

14.02 

3.64 

6  B 

26 

16.70 

3.58 

29 

16.86 

3.40 

38 

15.26 

3.14 

G 

47 

16.36 

2.86 

12 

17.66 

3.68 

54 

14.86 

3.28 

7  B 

29 

19.14 

2.40 

16 

16.62 

3.62 

53 

15.34 

3.18 

G 

31 

17.70 

3.46 

17 

14.64 

3.00 

34 

18.00 

2.48 

8  B 

41 

19.24 

2.62 

18 

19.56 

2.56 

28 

19.22 

2.48 

G 

47 

18.18 

2.64 

12 

16.34 

3.50 

33 

18.94 

2.42 

9  B 

37 

19.50 

2.48 

28 

20.64 

2.20 

24 

19.08 

2.56 

0 

38 

18.48 

2.28 

20 

19.10 

2.86 

39 

18.58 

2.60 

10  B 

21 

21.00 

2.22 

14 

22.14 

1.82 

20 

21.00 

2.28 

G 

22 

20.00 

2.60 

14 

20.28 

2.08 

20 

19.10 

3.38 

11  B 

12 

21.16 

2.37 

8 

21.00 

3.60  Gr. 

G 

19 

20.60 

1.98 

20 

20.20 

2.92 

2  5  32 

3.62 

2.52 

12  B 

6 

22.00 

1.00 

11 

21.18 

3.14 

G  31 

2.88 

2.26 

G 

14 

20.86 

2.06 

20 

19.80 

2.48 

3  fi47 
G  53 

6.74 
6.24 

3.66 
3.42 

*Iii  this  school,  the  different  types  of  schools  were  not  separated.  Both  one-room  and 
union  schools  are  represented. 
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Table  XVII 
COMPARISON  OF  ONE-ROOM  AND  UNION  SCHOOLS 


One-Room 

Union 

One 

-Room 

Union 

Yrs. 

and 

No.  of 

Sex 

Cases   Aver. 

a 

No. 

Aver. 

a 

Gra. 

No. 

Aver. 

a 

No. 

Aver. 

a 

SB 

22 

9.54 

3.74 

35 

38 

8.42 

3.86 

0 

18 

8.44 

3.82 

G 

24 

9.34 

4.56 

9B 

43 

11.98 

4.56 

20 

10.80 

3.84 

45 

280 

11.02 

4.08 

104 

11.14 

4.12 

G 

66 

11.30 

3.70 

33 

11.48 

3.92 

G 

278 

10.32 

3.78 

117 

10.32 

3.44 

10  B 

151 

12.38 

4.02 

53 

13.50 

4.04 

55 

267 

14.24 

3.12 

121 

14.84 

3.18 

G 

179 

11.86 

3.72 

85 

12.32 

3.78 

G 

219 

13.36 

3.60 

119 

13.56 

3.08 

UB 

175 

13.46 

4.14 

92 

14.32 

4.02 

65 

245 

16.32 

3.46 

119 

16.50 

3.36 

G 

172 

13.78 

4.30 

94 

13.90 

4.14 

G 

235 

15.42 

2.90 

113 

16.24 

3.08 

12  5 

237 

15.40 

4.16 

113 

15.58 

4.46 

75 

244 

17.76 

3.18 

95 

17.80 

3.16 

G 

232 

14.46 

4.36 

103 

15.64 

4.12 

G 

207 

17.42 

2.90 

112 

16.36 

3.38 

13  B 

212 

16.32 

4.04 

92 

17.94 

3.56 

85 

164 

19.16 

2.92 

121 

19.16 

2.70 

G 

178 

15.50 

3.88 

105 

15.64 

3.62 

G 

129 

18.02 

2.82 

113 

17.70 

2.86 

14  B 

176 

17.14 

3.84 

127 

18.38 

3.68 

95 

121 

20.00 

2.40 

G 

135 

16.44 

3.52 

145 

17.00 

3.80 

G 

128 

18.60 

2.68 

15  B 

133 

17.52 

3.76 

122 

18.98 

3.00 

10  5 

77 

20.80 

2.64 

G 

87 

17.06 

3.32 

112 

17.90 

3.78 

G 

70 

19.26 

2.84 

16  B 

54 

17.04 

3.56 

96 

19.38 

3.42 

115 

43 

21.10 

2.66 

G 

48 

16.62 

3.32 

94 

18.36 

3.32 

G 

81 

20.38 

2.14 

17  B 

74 

20.02 

3.34 

12  5 

52 

21.58 

2.16 

G 

90 

19.48 

2.64 

G 

66 

20.22 

2.46 

18  B 

53 

20.92 

2.54 

G 

65 

19.84 

2.52 

Table  XVIII  presents  the  statistical  reliability  of  the  differ- 
ences between  these  two  types  of  schools  for  the  various  ages 
and  grades.  Examining  the  girls'  results,  we  see  that  in  the 
age-to-age  comparison,  the  union  schools  make  a  consistently 
better  showing  though  the  difference  is  not  always  reliable. 
The  average  number  of  chances  for  a  true  difference  is  80.7 
in  100.  Dividing  the  age  groups  into  those  below  12,  and 
those  12  and  over,  our  averages  are  88.8  and  67  (chances  in 
100)  respectively.  This  is  what  we  should  expect,  because  at 
the  upper  ages  all  the  brighter  children  are  necessarily  in 
union  schools  since  one-room  schools  have  no  grades  above 
the  8th. 

As  far  as  the  grades  go,  the  honors  are  evenly  divided.  For 
the  4th  grade — perfect  equality;  for  the  5th  and  6th  grades, 
an  average  of  85.5  chances  in  100  for  a  true  difference  in 
favor  of  the  union  schools.  For  the  7th  and  8th  grades,  91 
chances  in  favor  of  the  one-room  schools. 

Turning  to  a  consideration  of  the  boys'  data,  we  find  that 
there  is  a  fairly  reliable  superiority  of  the  one-room  schools 
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Table  XVIII 
COMPARISON  BETWEEN  ONE-ROOM  AND  UNION  SCHOOLS 

Reliability  of  Differences — Girls 


Actual 

a 

Difference 

Chances  that  true 

Years 

Difference 

Difference 

in  ff  units 

diff 

is  above  0. 

(Favor  of  Union) 

9 

.18 

.83 

.22 

59      i 

nlOO 

10 

.46 

.49 

.94 

83      I 

nlOO 

11 

.12 

.54 

.22 

59      1 

nlOO 

12 

1.18 

.45 

2.60 

99.7  1 

nlOO 

13 

.14 

.45 

.31 

62      1 

nlOO 

14 

.56 

.44 

1.27 

89      i 

nlOO 

15 

.84 

.51 

1.6 

94      1 

nlOO 

16 

1.74 

.59 

2.9 

99.8 

nlOO 

Grades 

4 

0 

0 

nlOO 

5 

.20 

.35 

.57 

72 

in  100 

6 

.82 

.35 

2.30 

98.9 

in  100 

7 

—1.06 

.28 

—3.80 

100 

n  100  (1-rm) 

8 

—   .32 

.35 

—  .91 

82 

n  100  (1-rm) 

Reliability  of  Differences 

— Boys 

Years 

9 

—1.18 

1.11 

—1.06 

85 

in  100  (1-rm) 

10 

1.12 

.64 

1.8 

96 

mlOO 

11 

.84 

.53 

1.6 

94 

mlOO 

12 

.18 

.50 

.36 

64 

in  100 

13 

1.62 

.47 

3.45 

100 

in  100 

14 

1.24 

.40 

3.1 

100 

in  100 

15 

1.46 

.42 

3.5 

100 

nlOO 

16 

2.34 

.60 

3.9 

100 

nlOO 

Grades 

4 

.12 

.47 

.26 

60 

in  100 

5 

.60 

.35 

1.71 

96 

mlOO 

6 

.18 

.39 

.46 

67 

in  100 

7 

.04 

.37 

.1 

54 

nlOO 

8 

0 

0 

nlOO 

over  the  union  schools  at  nine  years.  Otherwise  the  age  re- 
sults are  consistently  in  favor  of  the  union  schools  with  an 
average  of  93.4  chances.  (The  9-year  discrepancy  may  proba- 
bly be  explained  as  in  Chapter  III.)  From  ages  13-16  the  dif- 
ference is  perfectly  reliable.  The  normally  advanced  13-year- 
old  will,  of  course,  be  in  high  school. 

Considering  the  grades,  though,  we  have  practically  the 
same  results  as  with  the  girls.  In  the  4th  to  6th  grades  there 
is  an  average  sigma  difference  (in  favor  of  the  union  schools) 
of  .81,  which  is,  of  course,  not  at  all  reliable.  Above  the  7th 
grade  there  is  equality. 

We  can  offer  a  plausible  explanation  for  the  sudden  turn 
of  the  tables  in  favor  of  the  one-room  schools  at  the  upper 
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grades.  There  is  probably  considerable  selection  at  the  upper 
ages.  The  one-room  school  children  are  more  retarded  for 
their  age  than  the  union  school  children,  and  with  the  fewer 
advantages  and  opportunities  they  have,  it  is  not  surprising 
that  the  dull  ones  drop  out  early.  It  has  been  shown  that  in 
New  York  three-fourths  of  the  children  in  the'  one-room 
schools  are  in  the  first  four  grades  (48).  This  is  what  we 
should  expect.  And  if  there  is  so  much  dropping  out,  is  it  not 
reasonable  to  suppose  that  there  is  in  the  topmost  grades  a 
veritable  survival  of  the  fittest? 

We  recently  ran  across  the  following  surprisingly  confirma- 
tory statement  by  Foote  (29),  who  made  a  study  of  10,999 
consolidated  school  pupils  and  4653  one-teacher  school  pupils. 
"There  is  a  pronounced  belief  among  school  people  acquainted 
with  the  conditions  that  there  is  a  higher  relation  between  in- 
efliciency  and  elimination  in  the  one-teacher  school  than  there 
is  in  the  consolidated  school.  In  other  words,  the  one-teacher 
school  retains  a  relatively  larger  number  of  its  proficient 
pupils  through  the  upper  elementary  grades  and  should,  if 
all  other  factors  were  equal,  show  superior  results  of  instruc- 
tion in  the  latter  grades."^-  Foote's  own  results  do  not  con- 
firm this  prophecy.  Ours  do,  however,  most  markedly.  The 
explanation  lies  in  the  fact  that  Foote  was  dealing  with 
academic  subjects  whose  results  would  clearly  reflect  the 
kind  of  teaching  enjoyed.  Our  test  would  probably  depend 
far  more  upon  original  innate  ability  than  special  teaching. 

In  regard  to  selection  at  the  upper  ages,  the  Assistant  Su- 
perintendent of  New  York  State  writes  as  follows:  "We  are 
doing  everything  we  can  to  encourage  common  school  dis- 
tricts to  send  both  their  7th  and  8th  grade  pupils  to  a  central 
rural  or  union  free  school  whenever  one  is  available.  .  .  . 
It  is  true,  however,  that  children  are  still  prepared  for  high 
school  in  a  large  number  of  one-teacher  schools.  I  think  it  is 
probably  safe  to  say  that  when  such  children  are  still  found 
in  the  one-room  school,  they  represent  two  groups.  Either 
they  are  the  cream  of  the  rural  community  because  other 
pupils  in  the  neighborhood  of  similar  age  and  grade  obtained 
their  working  papers  as  soon  as  they  completed  the  6th  grade 
and  reached  the  age  of  14,  and  dropped  out  of  school.  Or 
else  they  are  children  who  should  actually  be  in  high  school, 

'^  29,  p.  346. 
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but  are  held  back  because  they  failed  to  pass  some  one  of  their 
Regents  examinations  for  high  school  entrance."^^ 

Turning  to  other  studies,  we  find  that  we  are  in  complete 
accord  with  the  general  conclusion  that  union  schools  exceed 
one-room  schools  in  achievement.^^  Unlike  most  other  investi- 
gators, however,  we  cannot  show  an  entirely  consistent  or  re- 
liable difference  except  at  those  ages  at  which  a  fair  com- 
parison is  impossible. 

These  comparatively  small  differences  can  probably  be  laid 
to  the  lesser  opportunities  in  the  one-room  school.  The  union 
schools  are  far  more  elaborately  equipped,  both  from  the 
standpoint  of  health  and  educational  facilities.  The  one-room 
pupils  would  doubtless  be  at  a  disadvantage  in  practically  any 
field.  No  matter  how  much  a  test  may  tap  "innate"  intelli- 
gence, still  the  use  of  the  tools  at  hand  will  contribute  some 
small  fraction  to  the  final  score.  This  would  be  sufficient  to 
explain  our  differences. 

If  our  differences  are  smaller  than  those  of  other  investi- 
gators (as  appears  to  be  the  case),  it  may  be  that  it  is  because 
our  test  is  more  suited  to  both  groups  than  those  of  other  in- 
vestigators. Standard  tests,  scaled  on  city  children,  have  al- 
ways been  used  and  these  may  favor  union  school  children. 
If  so,  we  may  here  bring  to  bear,  to  a  lesser  degree,  the  argu- 
ment used  in  relation  to  the  comparison  of  city  and  rural 
children  by  such  tests.  This  point  will  be  elaborated  in  Chap- 
ter V. 


Summary 

1.  The  rural  schools  were  classified  into  one-room  and 
union  schools.  The  former  represents  the  "typically"  rural 
schools  in  outlying  districts.  The  latter  represents  the  con- 
solidated schools  serving  five  or  more  districts. 

2.  No  reliable  or  consistent  difference  was  found  between 
the  eight  districts  tested. 

3.  The  union  schools  were  found,  in  our  study,  to  be  fairly 
consistently  (although  not  entirely  reliably)  superior  to  the 
one-room  schools  up  to  the  7th  grade.  Selection  of  cases  above 
this  grade  in  the  one-room  schools  (and  confirmatory  evidence 


="  From  letter  from  Miss  H.  H.  Heyl  to  author. 

"  For  a   detailed   account  of  the  surveys   dealing  with  rural   schools 
the  reader  is  referred  to  the  bibliography  (particularly  to  30). 
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thereof)  was  offered  as  an  explanation  of  the  apparent  change 
at  the  upper  levels. 

4,  It  is  very  important,  since  such  differences  exist,  that  ma- 
terial gathered  for  purposes  of  standardization,  etc.,  should 
be  carefully  differentiated  so  that  groups  as  heterogeneous  as 
those  represented  above,  should  not  be  included  in  a  haphazard 
manner. 


CHAPTER  V 
Rural  and  Urban  Differences  on  Information  Tests 

A  AND  B* 

Nearly  thirteen  million  people  in  the  United  States  live  in 
villages.  Every  eighth  person  in  this  country  is  a  villager.^^ 
It  is  evident,  therefore,  that  any  blanket  statement  concern- 
ing the  mentality  of  the  rural  population  has  a  direct  bearing 
on  our  population  as  a  whole.  We  can  hardly  damn  our  coun- 
try dwellers  without  incriminating  ourselves  rather  deeply. 
The  Census  Bureau  has  estimated  that  with  a  total  population 
of  approximately  112  millions  in  1924,  there  were  a  little  less 
than  "10  million  children  enrolled  in  rural  schools  in  the  open 
country  and  in  villages  and  towns  of  1000  population  and 
under."^^ 

We  are  unable  to  cite  any  really  comprehensive  study  of 
the  mental  differences  between  rural  and  urban  children.  The 
thoroughgoing  research  undertaken  by  Baldwin  and  Fill- 
more (22)  has  not  yet  been  reported  in  full.  There  are,  how- 
ever, a  fair  number  of  partial  studies  which  we  shall  summa- 
rize below.  In  many  of  these  the  investigation  of  rural  men- 
tality has  been  merely  incidental  to  the  main  purpose. 

Pintner,  in  1917  (37)  tested  the  school  population  (154) 
of  a  village  of  913  inhabitants.  Using  his  Mental  Survey  test 
with  which  he  had  previously  tested  a  large  number  of  urban 
children,  he  found  that  the  median  index  of  mentality  of  the 
villagers  was  10%  below  the  urban  norm.  He  concludes 
that  the  more  intelligent  families  are  leaving  the  village 
community. 

Pyle  and  Collings  (40),  in  1918,  reported  the  results  of 
giving  the  entire  population  of  school  children  8-18  (2000) 
of  a  Missouri  county  the  Pyle  tests.  The  rural  boys  had  72.7% 
of  the  urban  boys'  standing ;  the  rural  girls  had  77.5  %  of  the 
urban  girls'  standing. 


*  We  wish  to  thank  the  following  rural  superintendents  for  their 
splendid  cooperation  with  us  in  our  work:  Mrs.  L.  T.  DeOlloqui,  Car- 
thage; Miss  M.  S.  Rundall,  Amenia;  Mrs.  R.  E.  Brown,  Granville; 
Miss  M.  L.  Isbell,  Norwich;  Miss  M.  L.  Rodgers,  Moravia;  Miss  M.  G. 
Hoffman,  Lewiston;  Miss  R.  M.  Libby,  Canton;  Mrs.  E.  D.  Grubb, 
Potsdam;    Miss  R.  S.  Gandy,  Dennisville,  N.  J. 

^25,  p.  15. 

^^26,  p.  339. 
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Pressey,  in  1920,  attempted  a  comparison  of  rural  and  ur- 
ban children  with  the  Pressey  Primer  Scale.  He  believed  that 
since  this  test  does  not  "involve  literacy,  nor  school  training, 
children  from  country  and  city  should  meet  the  examination 
on  equal  terms."^^  Also  the  scale  is  given  so  early  that  home 
influences  might  be  expected  to  have  operated  to  a  much  less 
extent  than  later.  Of  183  rural  children  of  6,  7  and  8  years, 
only  22%  scored  above  the  median  for  age,  as  determined 
from  city  children.  A  former  study  with  the  Pressey  Group 
scale  had  showed  that  only  27%  of  the  rural  children  tested 
above  the  urban  median  (39).  "It  would  seem  reasonable  to 
conclude  then,"  says  Pressey,  "that  the  differences  found  by 
both  scales  .  .  .  between  urban  and  rural  children  were  real 
differences  in  intelligence."^^ 

Irion  and  Fisher  (34),  1921,  found  that  361  rural  school 
children  (11-16  years  of  age)  scored  10  points  below  the 
urban  norm  on  the  National  Intelligence  test. 

Hinds,  1922,  comparing  68  rural  children  in  Texas  with 
urban  norms  on  the  Otis  test  concludes  "that  the  country 
child  is  lower  in  general  mentality  as  measured  by  the  group 
mental  tests  than  the  city  child."^^ 

Book,  in  1922,  reported  the  results  of  testing  7748  Indiana 
High  School  seniors,  1194  of  whom  were  recruited  from 
rural  schools.  His  battery  of  10  tests  contained  a  practical 
information  test.  The  median  score  of  the  rural  group  was 
found  to  be  below  that  of  the  urban  group.  However,  Book 
adds  the  following :  "Rural  schools  have  a  larger  percentage 
of  seniors  making  the  most  superior  grade  of  intelligence, 
while  the  city  schools  have  proportionally  more  seniors  making 
a  high  average  intelligence."^^ 

L.  S.  Hollingworth,  in  1926,  summed  up  her  impressions 
as  to  rural  mentality  as  follows :  "As  regards  the  comparative 
frequency  of  gifted  children  in  urban  and  rural  environ- 
ments, we  have  not  much  information  at  present.  Such  data 
as  bear  on  the  subject  indicate  that  we  shall  probably  find  a 
greater  proportion  of  gifted  in  the  cities  except  in  districts 
so  remote  from  means  of  transportation  as  to  have  precluded 
migration  of  intellectual  deviates  to  the  city.  With  the  easy 
facilities  for  travel  at  present  existing  almost  everywhere  in 

^'38,  p.  92. 
''Ibid.,  p.  93. 
'"  32,  p.  123. 
*^2Jf,  p.  235. 
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the  United  States,  it  is  not  surprising  that  we  find  relatively 
unintellectual  performance  in  mental  tests  among  rural  school 
children."^! 

Terman,  in  his  "Genetic  Studies  of  Genius"  (3),  strikes 
somewhat  the  same  note.  Half  of  the  parents  of  his  super- 
normal subjects  "were  born  in  cities  of  10,000  population  or 
over,  and  almost  a  quarter  in  cities  or  towns  of  1000  to  10,000 
leaving  only  (italics  are  ours)  a  quarter  for  rural  districts 
and  towns  or  villages  of  less  than  1000." 

Some  studies  in  our  field  are  contributed  by  English  au- 
thors : 

Bickersteth  (23),  in  1917,  tested  1200  children  in  the  ele- 
mentary schools  of  the  Yorkshire  Dales  and  of  Leeds.  The 
former  represents  extremely  isolated  rural  districts,  the  lat- 
ter an  urban  settlement.  On  the  whole,  the  Dales  children 
were  found  better  in  memory  tests  and  the  Leeds  children  in 
reasoning  tests. 

Thompson  (42),  and  later  Duff  (28),  working  with  the 
Northumberland  mental  test,  found  that  the  rural  districts 
gave  results  more  than  a  year  behind  the  large  cities. 

Turning  now  to  rural  surveys  in  the  United  States,  eight 
major  ones  warrant  mention: 

In  the  Virginia  Survey  (50),  in  1921,  the  rural  children 
were  found  to  be  from  1-1 1/^  years  behind  the  city  children 
in  the  school  subjects  measured. 

In  the  same  year,  10,000  children  in  the  counties  and  cities 
of  North  Carolina  (44),  and  in  1922,  16,700  pupils  in  Ken- 
tucky (46),  were  tested  in  school  subjects.  The  results  in 
both  cases  were  similar  to  those  cited  above. 

Works,  in  the  New  York  Survey  (48),  in  1922,  found  that 
on  the  Sigma  Silent  Reading  test  the  rural  scores,  grade  for 
grade,  were  considerably  below  city  norms.  This  was  true 
of  arithmetic,  history  and  other  academic  subjects. 

The  Indiana  Survey  (45),  in  1923,  found  the  one-room 
8th  grade  reading  scores  to  be  II/2  years  below  Indiana  city 
schools  and  the  union  schools  l/^  year  below.  Similar  results 
were  found  in  other  school  subjects. 

In  his  Texas  survey,  1925,  Works  (49)  measured  rural  and 
urban  children  with  the  National  Intelligence  test.  The  one- 
room  schools  were  found  to  be  about  li^  years  behind  the  city 
schools,  and  the  union  schools  about  i/^  year  retarded. 

"  33,  p.  58. 
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O'Shea  (47),  in  the  Mississippi  survey,  1927,  tested  grades 
1  and  2  with  the  Pintner  Cunningham  scale,  grades  3-8  with 
the  National  Intelligence  test,  and  grades  9-12  with  the  Ter- 
man  Group  test.  A  significant  difference  in  favor  of  the 
urban  children  was  found  to  obtain. 

Myers  found  that  the  Pennsylvania  rural  schools  (10,621 
8th  grade  pupils),  on  the  Otis  Classification  test,  rated  11% 
below  the  standard  (36). 

It  will  readily  be  noted  that  the  evidence  presented  so  far 
is  extremely  one-sided.  Everyone  agrees  in  favoring  the  urban 
child  as  far  as  mentality  and  school  achivement  is  concerned. 
It  is  true  that  we  have  omitted,  for  the  time  being,  one  or  two 
studies  to  be  discussed  later,  but  the  bulk  of  the  experimental 
work  has  been  reviewed.  We  may  now  turn  to  the  results 
of  our  own  study. 

The  T  scaling  and  standardization  of  Scaled  Information 
A  (on  urban  children)  has  already  been  described.  It  seemed 
to  provide  a  good  basis  for  the  comparative  study  of  urban 
and  rural  children.  Six  hundred  and  ten  children  from  50 
schools  in  one  rural  district  were  tested.  The  administration 
of  the  tests  was  conducted  as  before.  The  individual  teach- 
ers gave  the  test  according  to  specific  instructions.  This 
method  is  particularly  appropriate  in  the  case  of  rural  chil- 
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dren.  Pressey  has  pointed  out  the  fact  that  these  children 
are  shy  and  not  at  ease  with  strangers.  Names  of  the  chil- 
dren and  schools  were  omitted,  so  that  there  should  be  no 
impetus  for  cheating. 

Table  XIX  shows  the  results  in  comparison  with  the  urban 
figures.  With  the  single  exception  of  grade  8,  the  urban 
groups  exceed  the  rural.^"  The  reliability  of  these  differences 
is  also  contained  in  Table  XIX.  For  the  ages,  there  are  96.9 
chances,  on  the  average,  for  a  true  difference.  -^  The  rural  chil- 
dren are  about  a  year  retarded  all  the  way  along.  Graph  IV 
illustrates  this  clearly.  The  13-year  rural  score  is  equal  to 
the  12-year  urban;  the  16-year  rural  to  the  15-year  urban, 
etc.  The  grade  differentiation  is  entirely  reliable  at  grades 
4  and  5.  But  above  this  the  differences  vary  until  at  grade  8 
the  difference  is  in  favor  of  the  rural  children.  This  is  prob- 
ably explainable  on  the  basis  of  selection  as  we  have  already 
suggested  in  the  sex  comparisons. 

On  the  whole,  then,  our  results  agree  with  those  of  previ- 
ous investigators.  The  urban  children  are  approximately  one 
year  in  advance  of  the  rural  children. 

Various  explanations  have  been  advanced  to  account  for 
this  deficiency.  Pyle  and  Collings  put  forth  the  following  pos- 
sible reasons : 

1.  The  city  children  are  of  better  stock. 

2.  The  environment  of  the  city  hastens  development. 

3.  Better  teachers  and  schools  of  the  city  give  training  that 

enables  the  children  to  understand  better  what  is  ex- 
pected of  them.'*^ 

Pressey  has  commented  on  the  fact  that  rural  children  are  at 
a  disadvantage  through  shyness,  etc.,  when  tests  are  admin- 
istered by  strangers.^^  O'Shea  states  that  "the  superiority 
of  urban  over  rural  pupils  may  be  due  to  superior  educational 
facilities  in  the  way  of  more  capable  teachers,  more  extensive 
educational  equipment  and  more  time  spent  in  school  each 
year,  as  well  as  to  superior  native  ability.  It  is  probable  that 
there  is  a  selective  process  in  operation  .  .  .  leaving  the  more 
capable  stock  to  locate  in  the  cities."^^ 

These  quotations  represent  the  general  viewpoint  of  most 
of  our  authors.    Environment  in  the  form  of  poor  opportuni- 


*"  40,  p.  538. 
*'38,  p.  96. 
"  47,  p.  226. 
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ties  of  the  child,  or  heredity,  since  the  better  stock  has  left, 
are  invoked  to  account  for  the  inferiority  of  the  rural  child. 
For  the  most  part  this  inferiority  is  taken  for  granted.  There 
is  still  another  possible  explanation,  however.  Perhaps  the 
tests  do  not  fit  the  rural  children  as  v^ell  as  they  do  the  urban. 
The  country  children  may  be  different,  not  inferior.  A  soci- 
ologist has  recently  stated  our  viewpoint  rather  clearly.  "The 
farmer  is  neither  peculiar  nor  unique,  and  not  even  inferior; 
he  is  just  different.  "Did  you,"  says  Halstead,  "ever  try  to 
drive  13  pigs  out  of  a  cornfield  when  they  did  not  want  to  go?" 
The  city  man  has  had  no  such  experience.  The  problems  of 
the  farmer  are  not  those  of  the  city  man  and  consequently 
his  stock  of  ideas  is  not  the  same.  If  a  word  reaction  test 
were  given  to  a  group  of  farmers,  in  99  cases  out  of  100  the 
word  Chicago  would  bring  forth  the  response,  "Sears  Roebuck 
and  Co.,"  while  this  response  would  not  be  at  all  likely  to  ap- 
pear in  a  test  given  to  city  dwellers.  The  apperception  masses 
of  these  two  groups  differ  greatly,  and  most  naturally  the  re- 
sponses are  divergent. "^^ 

Perhaps  our  explanation  lies  not  in  the  superior  environ- 
ment or  heredity  of  one  group  over  the  other,  but  in  the  tests 
used  to  compare  them. 

It  is  certainly  true  that  the  majority  of  our  tests  are  stand- 
ardized on  white  urban  children.  Even  where  state-wide  sur- 
veys have  been  made,  the  tests  used  were  originally  scaled  on 
city  children.  In  the  first  place,  large  numbers  are  more 
readily  available  in  city  schools.  In  the  second  place,  city 
children  have  been  considered  "representative."  And  since  it 
is  urban  educators  who,  as  a  rule,  have  made  the  tests,  this  is, 
of  course,  readily  understandable.  The  same  thing  is  true  of 
inter-racial  and  national  differences.  The  white  man's  tests 
are  used  as  a  standard  with  disastrous  results  for  the  other 
peoples. 

In  racial  psychology,  this  unfairness  of  the  testing  is  being 
realized  in  many  quarters,  and  attempts  to  form  an  adequate 
universal  test  are  being  made.  A  glance  at  almost  any  of  our 
current  psychological  magazines,  however,  will  serve  to  show 
that  Italians,  Indians,  Japanese,  etc.,  are  still  being  tested 
with  our  group  tests  and  conclusions  drawn  with  or  without 
reservations.  We  shall  discuss  the  absurdity  of  this  in  greater 
detail  in  our  next  chapter.     One  quotation  will  suffice  here: 

*'  us,  pp.771-2. 
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"Some  of  the  most  commonplace  experiences,  for  the  average 
white,"  says  Garth,  "are  lacking  to  the  average  Indian.  For 
instance,  the  hogun  and  tepee  have  no  'chairs,'  'tables,'  'cel- 
lars'. .  .  .  But  a  knowledge  of  such  commonplace  things  and 
their  significance  in  civilization  is  presupposed  in  those  who 
are  to  pass  satisfactorily  the  white  man's  intelligence  tests. "'^^ 

It  is  unnecessary  to  labor  this  point.  In  such  cases  it  is 
obvious.  However,  the  same  thing  may  be  true  in  a  much 
more  subtle  way  of  the  differences  between  country  and  rural 
children.  For  some  reason,  our  city  tests  may  not  fit  our 
country  cousins,  so  to  speak. 

So,  as  has  been  described,  we  attempted  to  make  a  test  for 
rural  children  in  exactly  the  same  fashion  as  a  test  had  been 
constructed  for  the  urban  group.    This  B  test  was  then  given 

Table  XX 
GRADE  DISTRIBUTION  OF  RURAL  AND  URBAN  CASES— (Information  B) 


Grade 
and  Sex 

1-Rm 

Rural 
Union 

Undif. 

Total 

Urban 

3  B 
G 

38 

24 

3 
33 

47 
53 

88 
110 

4  B 
G 

280 

278 

104 
117 

52 
53 

436 

448 

136 
161 

5  B 
G 

267 
219 

121 
119 

56 
59 

444 
397 

119 
114 

6  B 
G 

245 
235 

119 
113 

38 
54 

402 
402 

151 
125 

7  B 
G 

244 
207 

95 
112 

53 
34 

392 
353 

79 

77 

8  B 
G 

164 
129 

121 
113 

28 
33 

313 
275 

9  B 
G 

121 
128 

24 
39 

145 
167 

10  B 
G 

77 
70 

20 
20 

97 
90 

11  B 
G 

43 
81 

4 
1 

47 
82 

12  B 
G 

52 
66 

2 

4 

54 
70 

Total 

2330 

1808 

674 

4812 

962 

J-4. 

''  57,  pp.  38J 
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to  the  original  urban  and  rural  districts  and  to  seven  other 

rural  districts.     The  distribution  of  cases  may  be  seen  in 

Table  XX. 

Table  XXI  and  Graph  V  show  the  comparison  of  urban 

and  rural  children  on  Test  B.     (Incidentally  the  sex  difference 

is  clearly  illustrated.)     One-room  school  children  have  been 

taken  as  the  basis  of  comparison.    Whereas,  for  conventional 

,.  ,  .,.,    Difference         ^          ,  „  ,         ^,     Difference 
reliability-o^ ^7-  must  equal  3,  here  the  -^^ ^7-  ranges 

from  5.56  to  9.33.^^  The  conditions  found  on  Test  A  (illus- 
trated in  Graph  IV)  have  been  exactly  reversed  and  very  em- 
phatically. 

Table  XXI 
RURAL  AND  URBAN  SCORES  ON  INFORMATION  B 

Comparison  Between  One-Room  and  Urban  (3  Schools)  Averages.* 


Rural 


Urban 


Grade 

and  Sex 


Aver. 


Diff.  in     Chances  that  true 
(7  Units      diff.  is  above  0. 


4  B 
G 

5  B 
G 

6  B 
G 

7  B 
G 


11.02 
10.32 

14.24 
13.36 

16.32 
15.42 

17.76 
17.42 


4.1 

3.8 

3.1 
3.6 

3.4 

2.0 

3.2 
2.9 


8.74 
7.94 

10.42 
9.44 

13.46 
11.72 

13.84 
13.38 


3.9 
2.9 

4.0 

3.8 

4.0 

3.8 

3.6 
3.6 


5.56 
7.21 

9.10 
9.33 

7.33 
9.25 

8.52 
8.78 


100  in  100 
100  in  100 

100  in  100 
100  in  100 

100  in  100 
100  in  100 

100  in  100 
100  in  100 


♦Also  see  Table  XXVII,  Chapter  VI. 

A  handful  of  other  investigators  have  also  been  loath  to 
conclude  that  urban  children  are  superior  to  rural. 

Gray  and  Marsden  (1922),  in  England,  tested  children  in 
the  Yorkshire  Dales  and  compared  the  results  with  those  of 
town  children.  They  conclude  that  "the  country  children  ex- 
amined are,  as  a  group,  more  intelligent  than  some  town 
classes  we  tested.  ...  At  least  .  .  .  our  results  do  not  sup- 
port the  assumption  that  the  children  in  the  country  are  much 
less  intelligent  than  the  children  in  the  town."^^  The  group 
studied  was  so  small,  however,  that  results  can  be  considered 
only  very  tentative. 


■"  The  differences  between  one-room  and  union  schools,  elaborated  in 
Chapter  IV,  pale  into  insignificance  beside  these  results. 
''  31,  p.  231. 
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Average 
Scores 


-KVRFW 


'     Grades 


Fig.  5 
Information  B.   Urban  (Average  3  Schools) 
and   Rural    (Average    One-Room    Schools) 

Scores 


The  most  important  study  has,  unfortunately,  to  date  been 
only  briefly  reported.  At  the  American  Psychological  Asso- 
ciation meeting,  1928,  Baldwin  and  Fillmore  reported  as  fol- 
lows :  "A  study  was  made  of  all  the  children  from  birth  to  16 
years  of  age  in  four  rural  communities  in  Iowa  in  which  chil- 
dren attend  one-room  schools  or  consolidated  schools,  and  of 
a  control  group  in  an  Iowa  city  with  a  population  of  15,000."^^ 
"When  compared  in  intelligence  with  children  at  large  by 
means  of  established  norms,  and  when  matched  with  city  chil- 
dren, the  rural  infants  show  no  noticeable  differences;  the 
rural  pre-school  children  show  some  inferiority  at  the  upper 

*"  22,  p.  185. 
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ages,  and  the  rural  school  children  show  mental  retardation 
that  becomes  increasingly  apparent  as  they  progress  through 
school.  ...  An  analysis  of  the  results  of  verbal  intelligence 
tests  reveals  a  striking  difference  in  the  language  ability  of 
rural  children  in  contrast  to  city  children.  An  analysis  of 
the  non-verbal  reactions  to  the  performance  tests  shows  that 
while  the  rural  children  are  handicapped  by  a  slower  rate  of 
action,  they  show  superiority  on  certain  tests  that  probably 
relate  to  their  experiences." 

"These  results  raise  the  fundamental  question:  Are  these 
inherent  differences  between  the  mental  traits  of  rural  chil- 
dren and  of  city  children  ?  Are  the  differences  that  have  been 
found  due  to  development  and  environment?  Or  are  any  of 
the  present  tests  for  measuring  traits  and  their  development 
adequate  for  rural  children  ?"^° 

We  contend  that  they  are  not,  and  believe  that  the  point 
has  been  at  least  partly  proved  by  the  demonstration  of  the 
fact  that  urban  pupils  do  as  poorly  on  rural-scaled  tests  as 
vice  versa. 

Several  objections  may  be  raised  here.  In  the  first  place, 
have  we  perhaps  so  selected  our  rural  questions  that  they 
favor  our  rural  subjects  unduly?  It  would,  of  course,  be  easy 
to  pick  questions  that  would  be  so  specialized  in  character  as 
to  ensure  the  inferiority  of  any  other  group  tested  with  them. 
We  do  not  believe  that  this  argument  can  be  fairly  launched 
against  us.  Our  80-question  preliminary  sheet  for  the  rural 
test  was  chosen  in  precisely  the  same  manner  as  the  80-ques- 
tion preliminary  urban  test,  i.e.,  from  the  questions  submitted 
by  the  teachers  of  the  children  of  the  group.  Any  bias  on  the 
part  of  the  author  (herself  distinctly  an  urban  product)  was 
in  favor  of  the  urban  children,  since  with  the  rural  tests  all 
questions  were  eliminated  which  seemed  to  her  to  be  at  all 
specialized.  In  the  final  test,  moreover,  it  must  be  remem- 
bered, the  questions  were  not  selected  on  the  basis  of  ease  of 
response  for  rural  children,  but  ran  from  very  easy  to  very 
difficult  for  that  group.  If,  in  the  more  or  less  mechanical 
selection  of  questions  with  the  same  number  of  sigma  units 
of  difference  between  them,  questions  particularly  favoring 
the  rural  children  were  chosen  is  not  this  criticism  equally 
true  of  our  urban  test  and  of  practically  all  other  tests?    Our 


Ibid.,  pp.  185-6. 
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B  test  is  certainly  no  less  fair  to  urban  children  than  all  other 
tests  may  be  to  rural  children. 

We  have  analyzed  in  detail  the  B  papers  of  a  number  of  ru- 
ral and  urban  children  (taken  in  exactly  similar  proportion 
from  grades  4-7).  On  question  4  the  urban  children  had  a 
larger  percentage  of  correct  answers.  (See  Table  XXII.)  Ques- 
tions 2,  13,  14,  15,  17,  18,  20,  21,  25  seem  to  be  equal  in  diffi- 
culty for  the  two  groups.^^  On  the  remaining  15  questions, 
the  average  sigma  difference  in  favor  of  the  rural  children  is 
.53. 

Table  XXII 

QUESTIONS  FAVORING  URBAN  OR  RURAL  GROUPS  (Information  B) 

Comparison  Between  School  II  and  3  Rm-al  Districts 

a  Difference 
Question  (Favor  of  Rural) 


1 

.48 

2 

.18 

S 

.47 

4 

—  .57 

5 

.20 

6 

.49 

7 

.35 

8 

1.64 

9 

1.05 

10 

.47 

11 

.63 

lie 

.47 

13 

0 

14 

—  .07 

15 

.19 

16 

.21 

17 

—  .19 

18 

.05 

19 

.58 

20 

—  .02 

21 

—  .06 

22 

.30 

23 

.40 

24 

.20 

25 

—  .16 

Considering  that  the  sigma  values  run  as  high  as  4.61,  this 
difference  is  so  comparatively  small  that  we  may  say  confi- 
dently that  though,  of  course,  these  questions  did  favor  the 
rural  children,  as  the  A  questions  favored  the  urban  children, 
still  they  were  not  at  all  unfamiliar  to  the  latter  group  or  out- 
side his  scope  of  information. 

We  also  attacked  this  problem  from  another  angle.    It  will 

"  In  this  study,  a  difference  of  less  than  .2  sigma  has  been  discounted. 
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be  remembered  that  nearly  50%  of  the  questions  in  the  orig- 
inal preliminary  scale  to  the  urban  test  were  included  in  pre- 
liminary scale  B.  Studying  these  36  overlapping  questions 
(shown  in  Table  XXIII),  we  find  that  17  are  passed  equally 
by  the  rural  and  urban  groups,  8  are  to  the  favor  of  the 
urban  group  and  11  to  the  advantage  of  the  rural  group. 

Table  XXIII 
OVERLAPPING  QUESTIONS 

Favoring  Rural  or  Urban  Children? 

(7  Difference 
{Favoring  Urban) 

How  many  cents  are  there  in  a  quarter? —  .22 

What  may  we  expect  when  we  see  heavy  black  clouds? —   .90 

What  is  our  national  song? .20 

How  much  does  it  cost  to  mail  a  letter  to  any  city  in  the  U.S.? —  .14 

Of  what  is  butter  made? —  .80 

W^hat  holiday  do  we  now  celebrate  that  was  first  celebrated  by  the 

Pilgrims? .52 

How  many  sides  has  a  triangle? .35 

How  old  must  you  be  before  you  can  vote? .10 

Of  what  is  paper  made? .16 

How  many  states  are  there  in  the  U.  S.? —   .27 

Name  four  different  trees .06 

Who  was  the  first  president  of  the  U.  S.? —   .03 

How  many  pints  are  there  in  a  quart? —   .30 

What  do  the  stars  in  the  American  flag  represent? —  .06 

What  is  the  capital  of  the  U.  S.? —  .12 

What  is  the  shortest  month  in  the  year? .20 

What  is  a  submarine  boat? .35 

Who  is  the  Governor  of  your  State? —  .07 

What  is  the  largest  city  in  the  U.  S.? —  .48 

Who  was  the  President  of  the  U.  S.  diu-ing  the  World  War? .67 

Why  should  we  kill  flies? —  .49 

Why  is  it  dark  at  night? .03 

Name  a  country  in  Europe  which  is  a  republic .13 

How  many  weeks  are  there  in  a  year? —  .02 

Why  don't  we  see  the  stars  in  the  daytime? —   .38 

About  how  often  do  we  have  a  full  moon? —   .06 

Where  does  Congress  meet? .09 

What  causes  an  eclipse  of  the  sun? .23 

Why  do  we  celebrate  the  4th  of  July? —   .30 

What  artificial  waterway  connects  the  Atlantic  with  the  Pacific? —   .17 

What  is  steam? —  .02 

What  form  of  government  have  we  in  the  U.  S.? —  .08 

What  is  the  economic  value  of  Alaska  to  the  U.  S.? —   .14 

Of  what  is  rubber  made? — 1 .  16 

Why  is  the  moon  light  at  night? .46 

Name  two  stones  used  for  building  purposes —   .28 

Leaving  out  one  large  difference  (for  the  question  "Of  what 
is  rubber  made?")  the  average  superiority  for  the  urban 
group  is  .37  sigma,  and  for  the  rural  group  .44  sigma.  Hardly 
a  substantial  difference!  This  would  seem  additional  proof 
for  our  statement  that  the  groups  are  different,  not  inferior  or 
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superior.  That  there  is  a  slight  advantage,  on  the  whole,  for 
the  rural  group  is  interesting.  These  overlapping  questions 
were  all  in  the  preliminary  urban  test,  but  necessarily  of  those 
not  included  in  the  final  test.  The  first  part  of  the  preceding 
statement  shows  that  we  did  not  intentionally  frame  our  test 
to  fit  one  specific  group.  But,  as  the  latter  part  of  the  sentence 
suggests,  in  the  scaling  the  more  urban  questions  apparently 
were  automatically  selected. 

It  may  be  well,  at  this  point,  to  consider  how  we  did  get 
from  80  questions,  which  might  presumably  have  fitted  any 
group,  an  urban  test  A  in  the  one  case  and  a  rural  test  B  in 
the  second.  There  are  several  steps  in  the  testing  process: 
(1)  selecting  the  preliminary  questions;  (2)  scaling  the  test 
from  any  group's  percentage  of  correct  answers  on  each  ques- 
tion; (3)  the  standardization  of  the  test.  It  is  obvious  that  the 
last  named  process  can  not  affect  the  test.  We  have  shown 
that  the  selective  process  did  not  occur  in  the  first  step.  By 
this  we  mean  that  either  a  rural  or  an  urban  test  could  have 
been  scaled  from  the  same  original  80  questions.  The  second 
step  must  be  the  deciding  factor.  We  select  from  the  material 
tried  out  on  the  urban  group,  for  example,  questions  evenly 
distributed  throughout  all  the  ranges  of  difficulty  for  that 
group.  Apparently,  however,  this  selection  does  not  equally 
strike  the  various  ranges  of  difficulty  for  another  group.  It 
may  be  that  instead  of  one  1  question  (i.e.,  1  in  difficulty), 
one  2  question,  etc.,  being  included  there  may  be  three  4  ques- 
tions for  the  second  group.  So,  if  the  individual's  range  of 
ability  is  less  than  4  he  has  a  much  lower  score  if  he  is  from 
the  second  than  if  he  is  from  the  first  group.  It  might,  of 
course,  happen  that  the  test  was  easier  for  the  second  group ; 
that  the  range  of  questions  was  skewed  in  the  direction  of  the 
easy  questions.  This  is  not  true,  however,  with  either  of  our 
groups  and  is  probably  much  less  likely  to  be  true. 

We  may  say,  then,  as  a  general  rule,  that  if,  on  a  group 
homogeneous  in  respect  to  one  quality,  one  scales  a  test  ac- 
cording to  the  procedure  outlined  above,  it  will  not  equally  tap 
all  ranges  of  ability  in  a  second  group  homogeneous  in  respect 
to  a  different  quality. 

The  point  has  been  raised  whether  this  would  be  true  of  8- 
and  10-year-old  age  groups,  for  example.  This  brings  us  into  a 
somewhat  different  realm.  A  10-year-old  group  is  not  really 
homogeneous  in  regard  to  a  different  quality  than  an  8-year- 
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old  group.  The  first  group  is  merely  more  mature,  farther 
along  the  same  path. 

Even  in  age  and  grade  groups,  however,  it  would  be  pos- 
sible, by  scaling  on  one  group  alone,  to  produce  a  test  not  valid 
for  other  groups.  In  our  scale,  the  preliminary  questions  were 
tried  out  on  all  ages  and  grades.  Any  question  that  seemed  to 
single  out  one  level  was  eliminated.  For  example,  the  question 
"Where  are  the  Great  Lakes?"  elicited  50%  correct  answers 
from  7th  graders  and  only  20%  from  11th  graders.  This 
was  obviously  because  this  question  is  studied  in  the  7th  grade 
and  forgotten  by  the  12th.  But  this  illustrates  the  fact  that 
if  one  used  only  7th  grade  children  one  might  scale  a  test  not 
entirely  fair  to  even  an  older  age  group. 

The  two  analyses  quoted  above  also  proved  that  we  cannot 
tell  a  priori  which  questions  are  going  to  favor  a  certain 
group.  A  glance  at  Tables  XXII  and  XXIII  will  bring  this 
out  clearly.  It  seems  strange,  for  example,  that  the  rural 
children  do  not  have  the  advantage  in  "telling  one  way  to  find 
out  the  age  of  a  tree,"  "giving  one  reason  for  the  rotation  of 
crops,"  "locating  the  Pole  Star,"  etc. 

To  further  substantiate  this  point  (that  questions  favoring 
one  group  cannot  be  selected  a  priori) ,  the  overlapping  ques- 
tions plus  a  few  others  from  Scale  B  were  given  to  14  rural 
superintendents,  with  the  following  directions :  "Place  a  check 
mark  beside  each  question  which  you  think  favors  rural  chil- 
dren (i.e.,  in  which  rural  children  might  be  expected  to  excel), 
an  equal  sign  where  the  chances  of  rural  and  urban  children 
would  be  alike.  If  the  question  seems  to  favor  the  urban  child, 
leave  it  unmarked." 

The  superintendents'  answers  were  scored  wrong  only  if 
they  favored  rural  instead  of  urban  or  vice  versa.  Equal  judg- 
ments were  not  recorded.  The  percentage  of  definite  judgments 
made  was  computed.  The  average  for  our  14  rural  superin- 
tendents was  82%.  This  seems  high  until  we  consider  that 
with  our  scheme  of  marking,  there  was  a  50%  chance  for  a 
correct  judgment.  Under  these  conditions,  such  an  average 
from  a  group  of  experts  in  the  field  is  significant.  If  they  can 
actually  designate  as  distinctly  rural  what  is  apparently  dis- 
tinctly urban  (or  vice  versa)  on  even  two  questions  out  of  the 
25,  we  certainly  cannot  safely  decide  a  priori  that  any  test 
favors  or  disfavors  or  is  equally  fair  to  any  group  or  groups. 

The  same  test  was  tried  out  on  the  Graduate  Seminar  in 
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Psychology  at  Columbia  University.  The  16  papers  were  re- 
cruited from  members  of  the  staff  and  graduate  students.  This 
might  be  considered,  I  think,  a  distinctly  urban  group.  The 
average  per  cent  correct  v^^as  83.  This  is  practically  identical 
with  the  findings  reported  above  and  is  to  be  interpreted  sim- 
ilarly. 

Reisner,  in  a  study  of  8th  grade  pupils  in  Pennsylvania,  con- 
ducted a  somewhat  similar  investigation.  A  number  of  people 
acquainted  with  testing  and  rural  and  urban  life  were  asked  to 
classify  the  questions  on  Otis  Self  Administering — Intermedi- 
ate Form  B,  as  to  whether  they  were  strictly  urban,  strictly 
rural  or  intermediate.  This  brought  out  several  interesting  re- 
sults. (1)  There  was  a  great  difference  of  opinion  among  the 
judges  themselves.  (2)  Questions  might  be  correct  from  a  ru- 
ral standpoint  but  not  included  in  the  urban  key,  e.g.,  "What  is 
the  most  important  reason  that  bright  lights  are  placed  in 
front  of  the  theatres  ?  so  that  people  can  see  where  they  are ;  to 
attract  attention  and  look  inviting;  so  that  people  can  see 
the  advertisements  better;  electricity  is  furnished  to  theaters 
cheaply;  to  help  light  up  the  streets."  Probably  the  first 
answer  would  be  most  reasonable  in  places  where  it  is  hardly 
necessary  to  present  a  lure  to  jaded  tastes.  (3)  The  urban 
children  did  better  even  on  many  questions  which  were  classi- 
fied as  rural,  especially  where  word  meanings  were  involved. 
In  computation,  however,  the  rural  group  excelled. 

We  cannot  subscribe  to  Reisner's  conclusion:  "This  .  .  . 
brings  out  the  fact  that  urban  pupils  score  higher  than  rural 
pupils  on  the  questions  classed  as  strictly  rural  as  well  as  on 
questions  classed  as  strictly  urban. "^^  Having  obtained  five 
judges  who,  vdth  several  differences  of  opinion,  rated  the  ques- 
tions, Reisner  then  concludes  that  certain  questions  are  rural, 
etc.  This  is  very  fallacious  reasoning.  That  it  is  possible  to 
select  questions  which  favor  rural  children  is  shown  by  our 
study.  It  is  not  vdse  to  assume  that  the  objects  around  one 
are  necessarily  familiar. 

Both  our  own  and  Reisner's  study  seem  to  point  conclu- 
sively to  the  fact  that  a  priori  judgments  have  little  validity 
and  are  a  very  frail  structure  on  which  to  build  reliable  com- 
parisons. 

In  the  second  place  we  may  be  criticized  for  any  general 
conclusions  we  may  make  since  we  have,  unlike  most  of  the 

''41,  p.  24. 
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other  investigators,  used  only  an  information  test  and  not  an 
intelligence  test.  We  did  this  advisedly.  We  believe  that  it  is 
the  information  difference  that  is  so  very  important.  A  stand- 
ard intelligence  test  is  such  a  composite  that  one's  total  score 
doesn't  tell  a  very  complete  story.  But  is  it  not  true  that  in- 
formation figures  largely  in  practically  each  one  of  the  tests? 
Some  of  the  group  tests  contain  sections  avowedly  informa- 
tional, but  such  tests  as  analogy  tests,  definitions,  etc.,  presup- 
pose a  certain  amount  of  information.  One  may  reason  re- 
markably clearly,  but  the  ease  with  which  one  completes 

A  policeman  is  to  a  burglar  as  a  cat  is  to  a  .  .  . 

is  a  function  of  one's  familiarity  with  the  duties  of  a  police- 
man and  the  vocation  of  a  burglar.  It  may  be  argued,  of 
course,  that  the  information  required  is  so  slight  as  to  be  the 
property  of  all  concerned.  This,  however,  is  not  true.  At  the 
higher  levels  the  information  required  is  almost  prohibitive, 
as  for  example,  in  the  vocabulary  test  of  the  Thorndike 
C.A.V.D.  test,  e.g. 

Sub  series  Q.     (To  supply  word  in  line  meaning  same  as  first 

word.) 

21  radial  light,  agitator,  straight  line,  root,  ray 

22  sequestrate  follow,  petition,  horseman,  confiscate,  redwood 
30  auricular       golden,  heard,  jointed,  distinct,  clear. 

It  may  be  objected  that  we  are  confusing  language  ability 
and  information,  but  is  the  difference,  after  all,  very  real?  If 
you've  never  seen  or  heard  of  an  orange,  you  can't  define  it. 
And,  moreover,  if  your  way  of  living  does  not  lead  to  the  ab- 
sorption of  literature  containing  such  words  as  "radial"  or 
"auricular,"  you  won't  succeed  well  in  this  test.  On  the  whole, 
of  course,  it  is  true  that  intelligence  may  be  gauged  by  one's 
ability  in  such  language  tasks,  but  comparisons  can  be  made 
only  when  the  testees'  environmental  opportunities  have  been 
equal.  As  Thorndike  himself  phrases  it:  "The  problem  of 
analyzing  a  person's  intellectual  ability  into  the  amount  due 
to  nature  and  the  amount  due  to  nurture  is  unsolved.  No 
task  or  test  has  been  proved  to  be  a  measure  of  the  former 
alone.  The  wisest  procedure  at  present  is  to  equalize  environ- 
mental forces  by  a  wide  variety  of  data  with  which  all  individ- 
uals have  had  adequate  experience  and  to  make  as  correct  al- 
lowance as  we  can  for  what  we  cannot  equalize."^^ 

"4,  p.  462. 
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But  the  selection  of  such  tasks  (i.e.,  those  with  which  all 
have  had  equal  experience)  cannot  be  made  a  priori.  This  has 
surely  been  abundantly  demonstrated  in  the  preceding  section. 

Thorndike  has  lately  supported  the  hypothesis  that  "the 
higher  forms  of  intellectual  operation  are  identical  with  mere 
association  or  connection  forming,  depending  upon  the  same 
sort  of  physical  connections  but  requiring  many  more  of 
them."^*  He  submits  this  hypothesis  "to  an  almost  crucial 
test  by  determining  the  correlations  within  the  upper  half  of 
intellectual  operations  with  those  in  the  lower  half  and  those 
between  the  upper  and  lower  halves,"  As  a  measure  of  the 
"higher"  he  used  sentence  completion,  arithmetic  problems 
and  analogy  tests.  As  means  of  more  purely  "association," 
vocabulary  tests,  routine  and  informational  arithmetic  and 
information  tests.  The  "higher"  abilities  were  found  to  cor- 
relate as  closely  with  the  associative  as  inter  se,  and  vice  versa. 
"These  facts  .  .  .  prove  that  mere  association  and  the  higher 
abilities  have  in  the  main  the  same  cause.  Almost  all  of  what 
is  common  to  the  one  sort  is  common  to  the  other."^^ 

To  those,  therefore,  who  would  criticize  us  for  making  any 
general  conclusions  from  results  on  information  tests  or  ally- 
ing our  results  with  the  broader  studies  of  other  investigators, 
we  may  say  (1)  that  intelligence  tests  are,  in  some  measure  at 
least,  information  tests;  and  (2)  that  the  same  abilities  are, 
to  some  degree,  tested  by  mere  information  tests  as  by  a  more 
complex  battery. 

When  we  come  to  analyze  the  results  of  some  of  our  authors 
who  have  given  details  of  their  work,  we  are  driven  still  more 
firmly  to  the  hypothesis  advanced  heretofore.  In  those  cases 
where  investigators  have  carefully  analyzed  their  data  they 
agree  with  us,  in  the  main,  in  attributing  the  obtained  differ- 
ences to  reasons  other  than  to  the  innate  inferiority  of  one 
group. 

Pyle  and  Collings,  (40),  for  example,  find  that  the  rural 
children  approach  the  urban  children  more  on  the  non-linguis- 
tic tests. 

Chapman  and  Eby,  comparing  15  one-room  rural  schools  in 
Ohio  with  a  large  city  school,  conclude  that  "the  superiority 
of  the  city  school  children  over  the  one-room  rural  school  chil- 
dren varied  approximately  in  direct  proportion  as  the  de- 


Ibid.,  p.  422. 
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mands  made  by  the  test  called  for  special  school  instruction 
as  opposed  to  general  powers  which  the  school  can  do  little  to 
make  or  mar."^^ 

In  several  studies,  as  for  example,  the  New  York  school 
survey  (48),  the  rural  children  have  been  found  to  be  equal 
to  the  urban  subjects  in  arithmetic  even  though  markedly  de- 
ficient in  other  studies. 

In  the  Bickersteth  study,  the  Leeds  (urban)  children  were 

inferior  to  the  Dales  (rural)  children  in  memory  work  and  not 

consistently  better  in  cross-out  tests,  etc.,  but  superior  in 

reasoning  (as  measured  by  the  Burt  analogy  test;  examples 

J.     ,  .  ,  policeman  :  burglar  :  :  cat  : 

of  which  are       ...         ,  .,  .       ^ 

writing  :  typewriter  :  :  voice  : ) . 

Bickersteth  appends  the  following  significant  note :  "If  the 
superiority  of  the  Dales  children  in  the  memory  test  were  in- 
deed a  racial  characteristic,  we  should  expect  to  find  it  un- 
changed in  the  Leeds  children  of  Dales  ancestry,  but  of  31 
such  children,  all  but  five  were  considerably  below  the  aver- 
age for  their  respective  ages  in  the  Dales  group,  but  the  same 
children  were  above  the  Dales  average  in  the  reasoning  test."^^ 

Lehman  and  Witty,  investigating  the  play  activities  of  rural 
and  urban  children,  find  that  their  recreations  are  very  dif- 
ferent and  believe  that  these  differences  are  "directly  trace- 
able to  environmental  opportunities."  The  possible  implica- 
tions of  their  study  they  state  as  follows :  "Numerous  inves- 
tigators have  yielded  data  which  show  that  rural  children  are 
somewhat  below  city  children  in  mental  age.  .  .  .  It  is  .  .  . 
plausible  to  assume  that  the  lower  mental  age  ratings  of  the 
rural  children  are  ...  a  result  of  the  situation  revealed  by 
the  above  data.  In  administering  mental  tests,  it  is  assumed 
that  the  individuals  tested  have  similar  environmental  back- 
grounds, equal  opportunities  for  acquiring  information,  etc. 
...  It  is  evident  .  .  .  that  the  rural  and  the  city  children  do 
not  have  the  same  social  contacts,  .  .  .  certain  it  is  that  the 
environment  of  the  town  and  country  children  are  quite  dif- 
ferent and  these  environmental  differences  may  have  an  influ- 
ence upon  the  mental  age  ratings  of  the  two  groups  of  chil- 
dren."58 

Baldwin  and  Fillmore,  to  whose  study  we  have  already  re- 
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ferred  in  some  detail,  found  that  whereas  rural  and  urban  in- 
fants and  younger  pre-school  children  were  alike  in  mentality, 
the  divergence  between  the  two  groups  increased  with  age. 
They  question  whether  the  differences  are  inherent  or  due  to 
development  and  environment,  or  whether  we  have  any  tests 
equally  suitable  for  the  measurement  of  the  two  groups.  It 
must  be  admitted,  of  course,  at  the  outset,  that  if  the  rural 
group  were  inferior,  the  difference  would  become  more 
marked  with  age.  Such  a  curve  does  represent  our  feeble- 
minded norms  in  divergence  from  the  average.  However,  is 
not  the  following  also  a  possible  explanation  of  Baldwin  and 
Fillmore's  results?  In  infancy  tests  we  are  compelled  to  use 
more  or  less  universal  material.  As  the  children  grow  older 
the  tests  become  more  and  more  linguistic  and  necessarily 
more  and  more  tinged  with  environmental  verbiage.  If  the 
thesis  that  we  have  set  forth  in  this  chapter  is  correct,  this 
would  also  account  for  the  growing  inferiority  of  the  rural 
group.  And,  with  this  explanation,  certainly  no  more  hypo- 
thetical than  any  other,  Baldwin  and  Fillmore's  results  neatly 
dovetail  with  our  own. 

Summary 

1.  The  importance  of  data  about  rural  children  is  evident 
when  we  realize  that  in  1924  there  were  10  million  children 
enrolled  in  rural  schools. 

2.  The  bulk  of  evidence  from  previous  studies  points  to  the 
conclusion  that  rural  children  are  inferior  to  urban  children 
mentally  and  scholastically. 

3.  We  have  offered  the  hypothesis  that  this  difference  is 
due  not  to  any  innate  intellectual  difference  between  the  two 
groups,  but  to  the  tools  used  in  measuring  them, 

4.  To  obviate  this  difficulty  our  Information  Test  B  was 
scaled  on  rural  children  just  as  our  Test  A  was  scaled  on  ur- 
ban children.  Each  test  was  administered  to  both  groups  of 
children. 

5.  On  Information  A  the  rural  group  was  found  to  be  about 
a  year  retarded  in  comparison  with  the  urban  group. 

6.  On  Information  B,  the  situation  was  entirely  reversed. 

(Difference 
— ^^ ^rangmg  from  5.56 

to  9.33)  was  found  between  the  performances  of  the  urban 
and  rural  groups. 
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7.  A  handful  of  other  investigators  have  come  to  conclu- 
sions that  may  be  compared  with  ours — notably  Baldwin  and 
Fillmore  in  their  very  comprehensive  study. 

8.  Analysis  of  urban  and  rural  answers  on  Test  B,  and  of 
overlapping  questions  in  preliminary  tests  A  and  B,  points  to 
the  conclusion  that  Test  B  is  no  more  specialized  in  favor  of 
rural  children  than  Test  A  (or  any  standard  test)  is  special- 
ized in  favor  of  the  urban  children. 

9.  From  the  same  analysis  we  produced  evidence  that  ques- 
tions "fair"  to  a  certain  group  cannot  be  selected  a  priori. 
This  was  also  affirmed  by  submitting  our  questions  to  14 
rural  superintendents  who,  despite  their  unusually  rich  ex- 
perience, were  unable  to  designate  correctly  (in  a  fairly  large 
percentage  of  the  cases)  which  questions  favored  the  rural 
children. 

10.  An  analysis  of  current  standard  group  tests  shows  that 
a  large  part  of  the  material  required  is  informational  in  char- 
acter. So,  our  results  may  be  said  to  have  some  application 
outside  the  narrow  sphere  of  individual  information  tests. 

11.  Through  the  entire  rather  involved  chapter,  we  have 
attempted  to  follow  the  thread  of  this  inquiry :  "Are  the  men- 
tal differences  found  between  urban  and  rural  groups  a  func- 
tion of  an  innate  intellectual  difference  or  of  the  tools  of  meas- 
urement?" Our  results  seem  to  point  to  the  second  explanation 
as  possible  and  indeed  probable. 


CHAPTER  VI 

The  Nationality  of  the  Subjects  and  the  Corresponding 

Scores 

The  question  of  racial  and  national  differences  has  long 
been  a  fascinating  one,  especially  in  this  country  which  draws 
its  peoples  from  such  varied  sources.  The  results  of  the 
Army  examinations  roused  fear  in  many  quarters,  and  gave 
rise  to  such  statements  as  the  following:  "We  are  being 
swamped  with  the  offscourings  of  Europe.  .  .  .  We  have  no 
place  in  this  country  for  'the  man  with  the  hoe'  stained  with 
the  earth  he  digs  and  guided  by  a  mind  scarcely  superior  to 
the  ox  whose  brother  he  is."^^  The  influence  of  such  a  view 
(i.e.,  of  the  native  inferiority  of  other  races  than  our  own) 
on  our  social  and  economic  policies  is  hard  to  estimate. 

In  the  next  few  pages  the  outstanding  studies  on  the  vari- 
ous groups  of  foreign  born  in  America  have  been  sketchily 
summarized  so  that  we  may  grasp,  if  possible,  the  general 
trend  in  this  field.  In  examining  these  studies,  we  hope  the 
reader  will  keep  in  mind  the  viewpoint  of  this  paper,  i.e., 
that  the  tools  of  measurement  must  be  evaluated  as  well  as 
the  intelligence  of  the  subjects  tested  by  them. 

Negro  Studies 

A  very  short  time  ago,  the  current  findings  as  to  the  racial 
inferiority  of  the  negroes  could  be  summed  up  as  follows: 
"On  the  whole,  there  are  found  to  be  distinct  differences  be- 
tween the  two  races  considered,  both  as  to  intellectual  ability, 
as  measured  by  the  tests  used,  and  in  school  achievement.  .  .  . 
It  is  shown  that  overlapping  in  intelligence  is  to  the  amount  of 
15  and  25%  of  the  colored  race  who  reach  or  exceed  the 
median  of  the  white."^" 

Now,  no  such  simple  statement  would  be  adequate  or  ac- 
ceptable. In  articles  referred  to  in  the  bibliography,  Peter- 
son (65),  Wells  (70),  and  Sunne  (67)  have  stressed  the  im- 
portance of  environment  and  training  and  the  impossibility 
of  comparing  the  groups  when,  for  generations,  these  factors 
have  not  been  equal.  Sunne  and  Davis  (56)  and  Pressey  and 

°»  68,  p.  611. 
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Shively  (2)  have  pointed  out  the  probable  unfairness  to  the 
negro  group  of  test  material  now  being  used.  Davis  has 
shown  the  importance  of  equalizing  educational  opportunities. 
Two  recent  studies  of  Klineberg  and  Herskovitz  may  be  briefly 
quoted  here  to  show  how  far  the  pendulum  has  swung.  Kline- 
berg, 1927,  used  performance  tests  with  white,  indian  and 
negro  children.  His  results  seem  to  show  that  the  speed  fac- 
tor in  the  performance  is  largely  environmental,  not  racial.^^ 
Herskovitz  measured  with  the  Thorndike  College  Entrance 
examination  539  adult  male  negroes  divided  into  eight  classes, 
according  to  white  characteristics.  "The  hypothesis  of  less 
negro  intelligence  and  racial  efficiency,"  says  Herskovitz, 
"when  compared  to  whites,  which  has  been  generally  accepted 
from  results  in  psychological  tests,  must  be  further  tested  by 
the  acceptability  of  its  logical  corollaries."  One  of  the  chief 
of  these,  he  believes,  is  that  in  mixture,  those  individuals  hav- 
ing the  most  white  blood  should  be  superior  to  those  having 
more  negro  blood.  The  correlations  of  the  psychological  with 
such  physical  characters  as  width  of  nose,  thickness  of  lips, 
etc.,  were  found  to  be  entirely  insignificant.  Herskovitz  dis- 
counts Ferguson's  results  on  the  ground  that  the  discrimina- 
tion within  the  negro  group  against  those  individuals  show- 
ing such  negroid  traits  as  dark  skin  color,  would  cause  dif- 
ferences in  social  environment  which  would  affect  the  mean 
standing  of  groups  selected  on  the  basis  of  these  traits. "^^ 
He  concludes,  in  the  light  of  his  findings  that  "the  basic  hy- 
pothesis of  white  superiority  in  general  social  efficiency  and 
innate  intelligence  is  to  be  gravely  doubted."*^^ 

Oriental  Studies 
All  the  comparative  studies  of  orientals  agree  that  the 
Chinese  and  Japanese  children  are  not,  on  the  whole,  inferior 
to  American  children  except  where  obviously  handicapped  by 
language  difficulties.  Particularly  interesting  to  us  are  the 
results  of  Wang  who,  in  1926,  tested  Chinese  and  American 
college  students  (paired)  with  a  series  of  tests.  He  found 
the  Chinese  decidedly  superior  to  the  Americans  on  number 
series  tests,  but  decidedly  inferior  on  general  information 
which  most  involves  language  difficulty  and  knowledge  of 
American  life  and  customs^^^ 
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Indian  Studies 

The  bulk  of  the  studies  of  Indian  children  has  been  contrib- 
uted by  Garth.  He  concludes  that  although  on  our  tests  the 
Indians  score  somewhat  below  the  white,  still  "because  of 
differences  in  social  status  and  temperament  we  cannot  con- 
clude that  our  results  are  true  and  final  measures  of  Indian 
children."^^  This  is  made  more  emphatic  by  the  previous  de- 
tailed discussion  of  the  difficulties  involved  in  giving  our  tests 
to  Indians  who  lack  our  most  commonplace  experiences. 

Helmer,  in  an  unpublished  thesis,  reports  an  attempt  to 
frame  a  test  made  up  from  experiences  common  to  three  In- 
dian tribes.  After  trying  out  this  test  on  both  whites  and 
Indians,  she  finds  that  those  tests  best  adapted  to  the  Indians 
are  least  adapted  to  the  white,  and  concludes  that  "it  would 
be  difficult  to  make  tests  which  would  fit  both  the  Indians  and 
whites  equally  well."^^ 

Klineberg,  1928,  finds  with  Indian  children  much  the  same 
results  as  those  reported  above  with  negro  children,  i.e., 
"There  is  evidence  that  the  superiority  of  white  over  Indian 
and  negro  children  in  performance  tests  is  largely  if  not  en- 
tirely a  superiority  in  scores  for  time.  There  is  no  superior- 
ity; and  in  some  cases  an  inferiority  in  the  scores  for  ac- 
curacy of  performance."*''' 

Comparative  Studies  on  Other  Non-Native  Groups  in 

America 

The  question  of  whether  verbal  material  is  an  important 
factor  in  our  testing  of  foreigners,  has  been  emphasized  in 
many  articles.  There  is  some  reason  to  believe  that  Italians 
rank  below  Americans  on  all  our  tests.  As  far  as  the  other 
groups  go,  however,  the  two  following  quotations  fairly  sum 
up  the  trend  of  current  opinion  based  on  experimental 
evidence. 

Hirsch,  1925,  comparing  his  results  on  11  groups  with  those 
of  Brigham,  says :  "We  can  fairly  and  safely  state  that  from 
30%  to  40%  of  the  mental  differences  between  the  English 
and  the  combined  non-English  speaking  groups  as  tested  in 
the  Army  were  due  to  a  language  handicap."^' 


"  57,  p.  389. 
"=  58,  p.  76. 
""  63,  p.  107. 
"^  60,  p.  341. 
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Kirkpatrick  states  that  "there  is  no  denying  the  fact  that 

the  superiority  of  the  Americans  is  chiefly  on  the  verbal 

tests."68 

There  is  some  evidence  to  the  effect  that  even  where  pre- 
sumably "non-verbal"  tests  are  used,  the  foreigners  have  still 
some  language  handicap. 

Jones  gave  the  Myers  mental  measure  (presumably  non- 
verbal) and  two  verbal  tests  to  children  of  native  and  foreign 
parentage.  The  results  seemed  to  point  to  the  following  con- 
clusion :  "The  fact  that  a  test  is  composed  exclusively  of  non- 
verbal material  is,  therefore,  no  proof  that  it  has  merit  as 
a  non-verbal  test."^^ 

Koch  and  Simmons,  using  the  Meyers  Pantomime  and  Na- 
tional Intelligence  test  with  native  and  foreign  children,  make 
this  statement :  "While  the  pantomime  test  reduces  to  a  mini- 
mum the  language  handicap  of  the  foreign  group,  it  is  not 
to  be  assumed  that  the  test  permits  all  of  our  subjects  to  op- 
erate under  equally  favorable  conditions.  It  is  questionable, 
for  instance,  whether  our  groups  have  had  equal  opportunity 
to  familiarize  themselves  with  many  of  the  concepts  included 
in  its  content."'^*^ 

We  wish  to  draw  attention  to  the  last  sentence.  This  is 
precisely  what  we  have  inferred  from  the  use  of  our  tests 
with  urban  and  rural,  native  and  foreign-born  children. 

All  in  all,  we  may  perhaps  subscribe,  at  least  to  some  de- 
gree, to  the  recent  statement  of  Dale  Yoder  on  the  present 
status  of  the  question  of  racial  differences.  "It  may  be  cor- 
rectly concluded  that  the  consensus  of  competent  scientific 
thought,  contemplating  the  inability  of  mental  testers  to  de- 
fine intelligence,  the  inadequacy  of  all  attempts  to  take  such 
factors  as  education,  social  status,  and  language,  into  proper 
consideration  and  the  deficiencies  of  testing  conditions,  finds 
no  proof  of  racial  inferiority  or  superiority  and  eliminates 
the  usual  methods  of  determining  such  standing  from  the  field 
of  scientific  usefulness. "^^ 

We  may  safely  say  that  there  is  a  growing  conservatism 
as  to  the  conclusions  we  can  draw,  and  more  and  more  a  dis- 

•^  62,  p.  90. 
""ffi,  p.  207. 
™  64,  p.  35. 
"  72,  p.  470. 
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position  to  criticize  our  tools  rather  than  our  subjects  in  the 
case  of  our  foreign-born. 

However,  whether  or  not  experiments  show  conclusively 
that  it  is  the  language  or  special  informational  character  of 
our  tests  that  penalizes  the  foreigner,  at  any  rate  it  will  be 
universally  conceded  that  the  performance  of  foreigner  and 
native  on  these  tests  is  different.  So  it  is  extremely  impor- 
tant to  know  whom  one  is  testing.  We  have  already  com- 
mented on  the  use  of  deplorably  small  numbers  in  establishing 
norms.  When  we  add  to  this  the  fact  that  the  children  in 
one  school  may  be  chiefly  Italian  while  the  children  in  the 
second  may  be  Finn  or  Russian  or  fifth-generation  Ameri- 
cans, it  is  obvious  that  comparisons  are  meaningless. 

Armstrong's  study  (55)  of  rural  and  urban  children  is  in- 
teresting in  this  respect.  She  tested  115  rural  children  in 
Katonah,  N.  Y.,  and  328  urban  children  in  New  York  city. 
Contrary  to  usual  results,  the  rural  children,  on  both  verbal 
and  non-verbal  tests,  ranked  higher.    Analysis  showed,  how- 


Table  XXIV 
PARENTAGE  OF  SUBJECTS— Information  B 


S.  and  2 

S.andl     & 

'.  only 

S.  and  2'  Pars. 

No.  of 

Sub]. 

No.  of 

Parents 

Parent       Amer. 

Foreign 

Countries 

Group 

Cases 

Amer.  Born 

Amer.  Born 

Born 

Born 

Re-presenied 

Rural 

% 

% 

'  % 

% 

Dist.  A 

436 

84 

11 

2 

3 

4. 

60%  Canadian 

Dist.  B 

262 

77 

6 

16 

1 

11. 

46%  Swedish 

Dist.  C 

370 

86 

5 

9 

0 

9. 

21%  Austrian 
21%  Czech 

Dist.  D 

519 

88 

5 

6 

1 

10. 

32%  Austrian 

Dist.  E 

561 

55 

19 

20 

6 

13. 

23%  Canadian 

Dist.  F 

1026 

72 

15 

11 

2 

15. 

22%  Polish 

Dist.  G 

338 

94 

2 

3 

1 

5. 

Dist.  H 

680 

80 

8 

10 

2 

14. 

25%  Russian 
19%  Italian 

Average 

77 

13 

7 

3 

(weighted) 

Urban 

Sch.  1 

283 

13 

16 

Go 

6 

14. 

39%  Italian 
45%  Finn 

Sch.  2 

247 

73 

12 

9 

6 

10. 

21%  Irish 
25%  Canadian 

Sch.  3 

342 

19 

14 

59 

8 

14. 

63%  Italian 
13%  Russian 

Average 

32 

14 

47 

7 

(weighted) 
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ever,  that  the  rural  group  was  entirely  American  (for  several 
generations)  while  the  urban  group  was  very  heterogeneous 
nationally.  When  the  latter  was  analyzed  as  to  parentage  it 
was  found  that  differences  were  a  function  of  the  number  of 
generations  in  this  country. 

We  have  analyzed  our  groups  according  to  the  birthplace 
of  the  parents.  These  data  (in  Table  XXIV)  are  presented  for 

Table  XXV 
Urban  Norms — Information  B 


School  I 

School  2 

School  3 

Yrs. 

No.  of 
Cases 

Aver. 

ff 

No.  of 
Cases 

Aver. 

ff 

No.  of 
Cases 

Aver. 

c 

and  Sex 

9  B 
G 

18 
11 

10.12 

8.82 

4.24 
4.04 

10  B 
G 

30 
49 

8.80 
8.56 

3.32 
2.64 

34 
30 

11.42 
9.26 

3.82 
3.00 

38 
35 

8.74 
8.54 

3.98 
3.92 

11  B 
G 

35 
56 

11.00 
9.74 

4.22 
4.00 

25 
41 

13.32 
12.08 

4.30 

4.28 

44 
36 

9.82 
8.06 

4.18 
3.72 

12  B 
G 

47 
36 

12.36 
11.22 

4.08 
4.08 

50 
42 

15.04 
13.80 

3.48 

3.82 

46 
37 

11.66 
10.08 

5.16 

3.82 

Gr.  and 
Sex 
4  B 
G 

48 
68 

8.62 
7.76 

3.38 
2.56 

48 

47 

10.38 
8.92 

4.44 
3.00 

40 
46 

6.90 

7.24 

2.82 
3.12 

5  B 
G 

31 
44 

10.22 
9.90 

3.76 
3.64 

31 
23 

12.42 
10.14 

3.30 
3.16 

57 

47 

9.42 
8.66 

4.12 

3.88 

6  B 
G 

46 
43 

13.40 
10.82 

2.60 
3.30 

53 

47 

15.26 
13.46 

3.10 

3.82 

52 
35 

11.66 
10.48 

4.88 
3.46 

7  B 
G 

25 
19 

14.36 
14.16 

3.28 
3.52 

13 
24 

16.54 
14.84 

2.38 
3.26 

41 
34 

12.66 
11.94 

3.72 
3.40 

Yrs. 
and  Sex 
9  B 
G 

32 
26 

9.26 
8.08 

Average  of  3  Urban  Schools 

Gr.  and 
Sex 
3.96                                 4  B 
3.52                                     G 

136 
161 

8.74 
7.94 

3.90 
2.94 

10  B 
G 

102 
114 

9.62 

8.74 

3.94 
3.18 

5  B 
G 

119 
114 

10.42 
9.44 

4.02 
3.76 

11  B 

G 

104 
133 

11.06 
9.96 

4.44 

4.24 

6  B 
G 

151 
125 

13.46 
11.72 

3.98 
3.80 

12  B 
G 

143 
115 

13.08 
11.80 

4.52 
4.00 

7  B 
G 

79 

77 

13.84 
13.38 

3.62 
3  62 
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both  rural  and  urban  groups  on  Test  B.  It  will  be  seen  at  a 
glance  that  the  rural  districts  are  chiefly  American.  Only 
10%  have  both  parents  of  the  subjects  foreign-born,  and  a 
considerable  percentage  of  these  are  English  speaking.  The 
three  large  urban  schools,  however,  are  strikingly  different 
in  make-up.  Schools  I  and  III  have  about  70%  of  foreign- 
born  parentage  (on  both  sides).  School  II  is  closely  similar 
to  our  rural  districts  with  73%  (as  compared  to  77%)  with 
both  parents  American  born.  Fifty  per  cent  of  the  foreign- 
born  parents,  moreover,  are  English  speaking  (i.e.,  Irish  and 
Canadian).  Of  the  foreign-born  in  District  A  (which  re- 
ceived both  A  and  B  tests)  60%  are  also  Canadian. 


Average 
Scores 


n 

13  /     /?^     y 


12 


9/  V-*      SeHOOLX...-.<^/RLS 

'-*'  ^  ^  "I     Grades 

Fig.  6.     Information  B.     Urban  Scores 
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Table  XXV  and  Graph  VI  show  the  scores  of  the  three 
schools  on  Test  B.  Table  XXVI  shows  the  reliability  of  the 
differences  between  these  schools.  There  is  a  very  significant 
difference  between  Schools  II  and  III,  and  a  consistent  though 
not  entirely  reliable  difference  between  Schools  I  and  II,  and 
Schools  I  and  III. 

Table  XXVI 
COMPARISON  BETWEEN  THREE  URBAN  SCHOOLS 


Reliability  of  Diflferences — Information  B 

School  1  and  School  2 

School  2  and  School  3 

Yrs.  Sex 

Actual 
Dif. 

{Fav. 
Sch.  2) 

a  Dif. 

Dif. 

in  a 
Units 

Chances 

True  Dif. 

Above  0 

(in  100) 

Actual 
Dif. 

{Fav. 
Sch.  2) 

cDif. 

Dif. 
in  a 
Units 

Chances 

True  Dif. 

Above  0 

10  B 

a 

2.62 
.70 

.90 
.66 

2.91 
1.06 

99.8 

85 

2.68 

.72 

.93 
.86 

2.88 
.84 

99.8 
80 

11  B 
G 

2.32 
2.34 

1.12 

.85 

2.07 

i.75 

98 
99.7 

3.50 
4.02 

1.07 
.91 

3.27 
4.42 

100 
100 

12  B 
G 

2.68 

2.58 

.77 
.90 

3.48 
2.87 

100 
99.8 

3.38 
3.72 

.91 

.87 

3.71 

4.28 

100 
100 

Gr 
and  Sex 
4  B 
G 

1.76 
1.16 

.81 
.54 

2.17 
2.14 

98.6 
98 

3.48 
1.68 

.78 
.63 

4.46 
2.67 

100 
99.7 

5  B 
G 

2.20 
.24 

.90 
.86 

2.44 
.28 

99.2 
61 

3.00 
1.48 

.81 

.87 

3.71 
1.70 

100 
96 

6  B 
G 

1.86 
2.64 

.57 
.75 

3.26 
3.52 

100 
100 

3.60 
2.98 

.80 
.81 

4.50 
3.68 

100 
100 

7  B 
G 

2.18 
.68 

.84 
1.06 

2.60 
.64 

99.5 

74 

3.88 
2.90 

.88 
.89 

4.41 
3.26 

100 
100 

School  1  and  School  3 

School  1  and  School  3 

Actual  Chances  Actual 

Dif.  True  Dif.  Dif.  Chances 

Yrs.        {Fav.  Dif.  in    Above  0  Gr.  and      {Fav.  Dif.  in  True  Dif. 

Sex       Sch.  1)  a  Dif.    <t  Units    {in  100)  Sex       Sch.  1)  a  Dif.    a  Units    Above  0 


10  B 

.06 

.89 

.07 

52 

4B 

1.72 

.66 

2.58 

99.5 

G 

.02 

.76 

.03 

51 

G 

.52 

.56 

.93 

82.5 

11  B 

1.18 

.96 

1.23 

88.5 

5B 

.80 

.87 

.92 

82 

G 

1.68 

.81 

2.07 

98 

G 

1.24 

.79 

1.56 

93.5 

12  fi 

.70 

.97 

.72 

76 

6B 

1.74 

.77 

2.26 

98.7 

G 

1.14 

.93 

1.23 

88.5 

G 

.34 

.77 

.44 

67 

IB 

1.70 

.88 

1.93 

97 

G 

2.22 

1.00 

2.22 

98.6 
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Scliool  II  is  outstandingly  superior  at  all  points.  School  I 
with  39%  Italians  is  second,  and  School  III  with  63%  Ital- 
ians is  lowest.  This  does  agree  closely  with  the  findings  of 
other  investigators.  We  shall  make  no  attempt  to  explain 
this  phenomenon.  Of  course,  under  no  circumstances  can  we 
make  any  generalizations  concerning  Italian  intelligence.  It 
may  well  be  that  the  type  of  employment  we  have  to  offer 
selects  out  the  lowest  type  of  Italian  for  immigration.  On 
the  other  hand,  it  may  be  that  the  Italians  we  have  are  not 
dull  but  that  the  tests  put  them  at  a  special  disadvantage, 
linguistically  or  otherwise. 

Returning,  however,  to  our  rural-urban  comparisons.  It 
would  be  unfair  to  draw  any  conclusions  as  to  rural  superi- 
ority (on  Test  B)  from  the  results  of  tests  on  Schools  I  and 
III.  For  the  reasons  outlined  above,  however,  comparison 
with  School  II  is  entirely  in  order.  Table  XXVII  and  Graph 
VII  show  the  differences  between  rural  District  A  and  urban 
School  II.  Whereas  these  differences  are  not  as  marked  as 
in  Graph  V  (Chapter  V),  still  they  are  consistently  and 
fairly  reliably  in  favor  of  the  rural  district.     In  the  former 

Difference 
case,  the  -^^ n-  is,  at  its  lowest,  5.66,  at  its  highest,  9.33 

(where  conventional  reliability  is  3).  In  the  latter  case,  the 
average  number  of  chances  (in  100)  of  a  true  difference 
is  99.2. 

Table  XXVII 
RURAL  AND  URBAN  SCORES  ON  INFORMATION  B 


Reliability  of  Difference  Between  Rural  District  A  and  Urban  School  II.* 

Grade 
and  Sex 

Actual  Difference 
(Favor  of  Rural) 

a  Difference 

Difference 
in  a  units 

Chances  that  true 
diff.  is  above  0 

4  B 
G 

1.52 
1.80 

.79 

.78 

1.92 
2.31 

97      in  100 
98.9  in  100 

5  B 
G 

2.24 
2.64 

.77 
.87 

2.91 
3.03 

99.8  in  100 
100      in  100 

6  B 
G 

1.44 
1.80 

.63 
.71 

2.29 
2.54 

98.9  in  100 
99.4  in  100 

7  B 
G 

2.30 
3.42 

.85 
.83 

2.71 
4.12 

99.7  in  100 
100      in  100 

*  Also  see  Table  XXI,  Chapter  V. 


72   INVESTIGATION  INTO  THE  VALIDITY  OF  NORMS  WITH 


Average 
Scores 


Grades 

Fig.  7.    Information  B.    Urban  (School  II) 
and  Rural    (District  A)    Scores 

Our  conclusions  as  to  urban  rural  differences  on  Test  B 
still  hold,  therefore,  when  the  two  groups  are  equalized  as  to 
nationality  components. 

We  have  brought  to  light  the  striking  differences  between 
Schools  I,  II  and  III  in  the  same  city.  Any  one  of  these 
schools  would  have  provided  numbers  as  large  as  is  used  in 
most  norm  establishing,  but  the  results  in  no  two  of  them 
would  have  been  alike.  This  is  an  extremely  important  point 
too  often  lightly  passed  over  by  standardizers. 

The  literature  we  have  summarized  has  brought  out  the 
fact  that  the  different  races  and  nations  differ  decidedly  in 
their  informational  and  language  equipment.  It  would  seem 
superfluous  to  mention  this  except  for  the  fact  that  conclu- 
sions are  constantly  being  drawn  without  taking  this  suffi- 
ciently into  consideration.     In  extreme  cases,  as,  for  exam- 
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pie,  testing  primitive  man,  they  seem  rather  obvious,  but 
when  w^e  are  testing  children  w^ho  have  been  in  our  own  schools 
and  who  live  in  our  own  country,  we  are  too  apt  to  class  them 
all  as  living  in  the  same  environment,  whether  they  dwell  on 
farms  or  in  foreign  quarters,  or  in  the  shadow  of  the  campus. 
Porteus  and  Babcock  voice  this  criticism  rather  emphatically : 
"The  Army  Alpha  test,  if  it  does  nothing  more,  proves  con- 
clusively how  little  the  psychologists  know  of  the  mental 
range  of  the  man  in  the  street,  the  laborer  on  the  farm,  the 
mechanic  in  the  shop,  in  short,  of  the  average  man  whose  in- 
telligence he  seeks  to  measure."  .  .  .  "Even  so  in  direc- 
tions, e.g.,  Test  VII,  'What  you  are  to  do  in  each  line  is  to  see 
what  the  relation  is  between  the  first  two  words  and  under- 
line the  word  in  heavy  type  that  is  related  in  the  same  way 
to  the  third  word.'  For  the  man  whose  only  idea  of  relations 
is  of  his  uncles  and  aunts,  these  directions  would  seem  very 
involved  and  quite  incomprehensible."  More  so  in  the  vo- 
cabulary test:  'allure-attract;  deride-ridicule ;  haggard- 
gaunt  ;  orifice-aperture"  are  pairs  of  words  which  come  quite 
early  in  this  test  and  are  surely  outside  the  ordinary  man's 
range  of  understanding.  Quite  evidently  this  is  no  test  of 
intelligence  except  for  those  who  have  had  considerable  edu- 
cational opportunities."  .  .  .  "How  unfortunate  that  the 
farmers,  the  mechanics,  the  electricians,  could  not  devise  a 
test  for  the  psychologists.  If  they  did,  one  wonders  what  the 
mental  age  of  the  latter  would  appear  to  be."^^ 

Summary 

1.  A  brief  summary  of  studies  on  racial  and  national  dif- 
ferences in  mentality  seemed  to  point  to  the  conclusion  that 
we  are  growing  more  conservative  in  our  interpretations. 
There  is,  in  many  quarters,  at  least  some  appreciation  of  the 
fact  that  no  dogmatic  conclusions  can  be  drawn  as  to  the 
comparative  intelligence  of  various  groups,  while  our  tools 
and  methods  are  still  so  imperfect. 

2.  Analysis  of  our  urban  and  rural  groups,  according  to  the 
parentage  of  the  subjects,  reveals  the  fact  that  the  rural  popu- 
lation is  very  largely  native  American  while  the  urban  school 
population  varied  from  10%  to  73%  with  both  parents  for- 
eign-born. 

"  66,  pp.  197-9. 
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3.  School  II,  with  the  smallest  number  of  foreign-born, 
is  outstandingly  superior  on  our  tests. 

4.  The  children  of  School  II  give  us  a  fair  basis  of  compari- 
son with  our  rural  subjects.  But  the  difference  on  Informa- 
tion B,  already  elaborated  in  Chapter  V,  still  holds  when  the 
national  and  racial  composition  of  the  two  groups  is  equated. 

5.  The  reliable  differences  found  between  the  three  urban 
schools  (any  of  which  contains  a  large  enough  number  of 
cases  to  satisfy  most  norm  makers)  shows  us  how  careful 
we  must  be  in  the  selection  of  our  subjects,  and  the  caution 
we  must  observe  in  comparing  groups.  Mere  numbers  do 
not  seem  to  iron  out  differences. 


CHAPTER  VII 

Summary  and  Conclusions 

Our  aim,  as  stated  in  the  introduction,  was  twofold:  1,  to 
examine  the  importance  of  the  differentiation  of  norms  ac- 
cording to  sex,  racial  composition,  etc.,  and  2,  to  ascertain 
whether  mental  differences  between  groups  were  a  function 
of  their  innate  intelligence  or  our  tests  as  tools. 

In  the  six  preceding  chapters  we  have  examined  our  data 
from  these  viewpoints  and  have  arrived  at  certain  conclu- 
sions summarized  at  the  end  of  each  chapter.  On  the  whole, 
five  conclusions  are  outstanding: 

1.  The  adequate  scaling  and  standardization  of  tests  is 
the  first  essential  of  their  use  as  reliable  tools. 

2.  Large  numbers,  differentiation  of  the  groups  as  to  age, 
sex,  education  and  natio-racial  composition  are  abso- 
lutely necessary.  Heterogeneous,  hodge-podge  groups 
are  useless,  if  the  results  on  one  group  are  to  be  com- 
pared with  those  of  another. 

3.  We  have  found  that  our  rural  group  fell  below  the 
urban  group  on  Information  A,  scaled  on  urban  chil- 
dren. It  is  also  true,  however,  that  our  urban  chil- 
dren fell  below  the  rural  group  on  Information  B, 
scaled  on  rural  children.  The  groups,  therefore,  are 
different  and  inferiority  is  dependent  on  which  group 
the  existing  tool  favors. 

4.  Great  natio-racial  differences  were  found  between  our 
three  urban  schools.  The  test  scores  showed  a  dis- 
tinct correlation  with  these  differences.  Extreme 
caution  must  then  be  used  in  the  selection  of  groups 
for  scaling  and  standardizing  tests.  We  have  observed 
that,  in  practically  all  comparisons,  tests  scaled  on 
one  group  have  been  utilized,  usually  to  the  dispar- 
agement of  the  second  group.  Informational  and  lan- 
guage factors  have  been  shown  to  be  so  important 
that  such  a  procedure  is  obviously  unfair  and  unsci- 
entific. 

5.  An  analysis,  from  our  own  point  of  view,  of  the  litera- 
ture on  national  and  racial  differences  leads  us  to  the 
hypothesis  that  the  groups  are  different  rather  than 
that  one  is  superior  or  inferior. 

It  may  be  said,  of  course,  and  with  some  justice,  that  we 
have  as  much  bias  towards  our  interpretation  of  the  facts 
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as  the  other  investigators  whom  we  have  criticized.  The 
reader,  then,  may  take  a  middle  course  and  steer  between  the 
two  extremes. 

For  practical  purposes,  our  findings,  even  if  taken  seriously, 
do  not  radically  change  the  testing  situation.  It  still  is  true, 
for  example,  that  in  order  to  do  well  in  our  schools  a  certain 
grade  of  performance  on  oicr  tests  is  necessary.  So  it  is  per- 
fectly justifiable  to  put  any  individual  from  any  group  through 
our  tests  and  on  the  basis  of  the  results  classify  him  in  a  cer- 
tain way  in  regard  to  a  specific  school,  job,  etc. 

In  the  same  way,  we  may  put  one  of  our  own  group  through 
an  elementary  geography  test  and  if  he  fails  we  may  say  with 
justice  that  he  cannot  be  admitted  to  an  advanced  class. 
In  neither  case,  however,  can  we  draw  any  valid  conclusions 
as  to  innate  intelligence. 

We  have  not  meant  in  any  way  to  disparage  the  value  of 
mental  tests.  Rather,  let  it  be  said  that  we  so  firmly  believe 
in  their  use  that  we  are  loath  to  see  their  scientific  footing 
jeopardized  by  the  way  in  which  they  have  been  treated  by 
many  investigators.  At  some  time  in  the  future  we  may 
so  perfect  our  weapons  of  attack  that  we  may  make  valid 
comparisons  between  different  groups.  At  present,  let  us 
frankly  admit  that  we  have  no  adequate  method  of  estimating 
in  any  final  way  the  mental  differences  between  the  various 
races  and  nations.  All  studies  must,  then,  be  very  cautiously 
received  and  evaluated  according  to  the  methods  and  tools 
used. 
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APPENDIX 

PRELIMINARY  SCALE  A 

1.  What  state  do  you  live  in?  ,         ,  .  « 

2.  What  people  were  in  America  when  the  white  men  came.' 

3.  What  colors  are  in  the  rainbow? 

4.  Why  does  the  beating  of  your  heart  keep  you  alive? 

5.  What  is  a  submarine  boat? 

6.  What  causes  an  eclipse  of  the  sun? 

7.  What  is  the  value  of  the  smallest  silver  coin  we  use.' 

8.  Who  is  president  of  the  United  States? 

9.  What  is  the  shortest  month  in  the  year? 

10.  Of  what  is  rubber  made?  ,    ,        ^u       4.u  4- 

11.  How  is  it  that  newspapers  can  be  sold  for  much  less  than  the  cost 
of  printing  them? 

12.  Of  what  are  shoes  made? 

13.  What  is  the  largest  city  in  the  United  States? 

14.  Name  four  different  trees. 

15.  In  what  country  is  Vienna? 

16.  What  is  the  usual  economic  result  of  the  over-production   of  any 
commodity? 

17.  What  is  our  national  song? 

18.  Why  should  we  kill  flies?  .  ,.     .     o 

19.  In  what  month  of  the  year  do  the  days  begin  to  grow  shorter .' 

20.  How  can  banks  afford  to  pay  interest  on  the  money  you  deposit? 

21.  Why  is  it  dark  at  night?  •     ^u     tt   -^  ^  o^  ^     9 
22    What  form  of  government  have  we  m  the  United  States.' 

23!  Name  at  least  three  bodily  processes  that  go  on  when  a  person  read- 
ing music  plays  the  piano? 

24.  What  is  the  shape  of  the  earth? 

25.  Name  three  precious  stones? 

26.  Why  is  the  moon  light  at  night?  ,       .       ,      tt   -^  j 

27.  How  much  does  it  cost  to  mail  a  letter  to  any  city  m  the  United 
States? 

28.  Of  what  is  butter  made?  .        .  ,     ,      x^     -^  » 

29.  What  artificial  water  way  connects  the  Atlantic  with  the  Pacific' 

30.  Who  was  the  first  president  of  the  United  States? 

31.  Where  does  the  sun  rise? 

32.  Name  a  country  in  Europe  which  is  a  republic. 

33.  How  do  you  know  a  policeman  when  you  see  him? 

34.  How  many  states  are  there  in  the  United  States? 

35.  Who  is  the  governor  of  your  state? 

36.  What  is  the  function  of  respiration? 

37.  What  may  we  expect  when  we  see  heavy  black  clouds? 

38.  What  do  the  stars  in  the  American  flag  represent? 

39.  What  is  a  referendum  in  government? 

40.  Name  five  vegetables. 

41.  What  is  steam? 

42.  What  is  the  economic  value  of  Alaska  to  the  United  States? 

43.  What  is  the  capital  of  the  United  States? 

44.  Why  do  we  celebrate  the  Fourth  of  July? 

45.  What  are  the  functions  of  the  three  branches  of  our  government? 
(In  three  words.) 

46.  How  many  months  are  there  in  a  year? 

47.  What  three  things  do  most  plants  need  in  order  to  live? 

48.  For  how  many  years  is  the  president  of  the  United  States  elected? 

49.  What  is  the  largest  river  in  the  United  States? 

50.  In  your  city  what  is  the  youngest  age  at  which  a  child  can  leave 
school? 

51.  Name  the  greatest  English  writer  of  plays. 

52.  Of  what  use  are  insects  to  flowers? 

53.  To  what  public  building  can  you  go  for  books? 

54.  Where  does  Congress  meet? 
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55.  What  is  a  civil  war? 

56.  How  many  cents  are  there  in  a  quarter? 

57.  Why  don't  we  see  the  stars  in  the  daytime? 

58.  Why  did  the  Pilgrims  come  to  this  country? 

59.  How  many  sides  has  a  triangle? 

60.  How  can  you  tell  when  water  is  boiling? 

61.  Who  was  President  of  the  United  States  during  the  World  War? 

62.  What  holiday  comes  in  December? 

63.  What  part  of  the  night  or  day  is  12.30  A.  M.? 

64.  What  is  the  freezing  point  of  water? 

65.  How  many  hours  are  there  in  a  day? 

66.  How  old  must  you  be  before  you  can  vote? 

67.  Of  what  is  paper  made? 

68.  Name  the  Great  Lakes. 

69.  What  is  vaccination  for? 

70.  About  how  often  do  we  have  a  full  moon? 

71.  Name  four  general  reasons  that  prevent  a  would-be  immigrant  from 
entering  the  United  States. 

72.  What  are  the  colors  in  the  American  flag? 

73.  What  holiday  do  we  now  celebrate  that  was  first  celebrated  by  the 
Pilgrims? 

74.  Name  five  insects. 

75.  Name  three  wars  in  the  United  States  fought  with  other  countries. 

76.  How  many  weeks  are  there  in  a  year? 

77.  Name  two  stones  used  for  building  purposes. 

78.  How  many  pints  are  there  in  a  quart? 

79.  Name  five  cities  of  the  United  States  that  have  a  population  of  over 
half  a  million. 

80.  Why  are  there  no  shadows  on  a  heavily  clouded  day? 


KEY  TO  SCALED  INFORMATION  A 

1.  Red,  white  and  blue. 

2.  Leather,  satin,  wood,  etc.     (Any  sensible  answer  is  accepted.) 

3.  Twelve  or  twenty-four. 

4.  Christmas. 

5.  President  at  time  of  test. 

6.  Indians,  red  men. 

7.  State  child  lives  in. 

8.  East. 

9.  Any  five  vegetables.     (No  partial  credits  allowed.) 

10.  Mississippi  or  Missouri-Mississippi. 

11.  Religious  toleration,  freedom  from  persecution,  right  to  worship 
God  in  own  way.     (Any  phrasing  of  above  idea  is  accepted.) 

12.  Four  years. 

13.  Sunshine  or  warmth,  water  or  rain,  soil  or  ground,  air.  Any  three 
of  the  preceding  (or  their  chemical  components).  Only  one  mem- 
ber of  a  pair  accepted. 

14.  Circulates  blood,  sends  blood  through  veins,  pumps  blood.  (Any 
phrasing  of  this  idea  accepted.) 

15.  They  loan  it  at  higher  interest,  they  buy  mortgages.  (Any  answer 
that  includes  idea  of  using  money  accepted.) 

16.  Any  five  insects. 

17.  War  between  two  parts  of  same  country,  same  countrymen  fighting, 
brother  against  brother,  etc. 
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18.  At  least  three  of  starred  cities  below  and  two  of  the  others:     (Four 
starred  and  one  other,  or  five  starred.)' 

Akron  Columbus  Minneapolis  Providence 

Atlanta  *  Detroit  Milwaukee  Rochester 

♦Baltimore  Denver  Newark  St.  Paul 

*  Boston  Indianapolis  *New  York  ''St.  Louis    ^ 

*  Buffalo                    Jersey  City  Oakland  *San  Francisco 
Brooklyn                  Kansas  City  *  Philadelphia  Seattle 

♦Chicago  *Los  Angeles  *  Pittsburgh  Toledo 

Cincinnati  Louisville  Portland,  Ore.         Washington 

♦Cleveland  *  Manhattan 

19.  Any  answer  that  mentions  advertising.     (Large  production  not  ac- 

20.  32  or  32  Fahrenheit  or  0  Centigrade.     (Zero  not  accepted.) 

21.  Higher  prices.     (Waste,  panic,  etc.,  accepted.)  . 

22.  Executive  or  administrative,  judicial,  legislative.  (Any  phrasing 
of  these  ideas  accepted.)  .  ,     ,       j. 

23.  Quota  exhausted,  defective  mentality,  contagious  disease,  lack  ot 
funds,  moral  turpitude,  criminality,  beliefs  contrary  to  United  States 
Constitution,  bigamy,  member  of  excluded  race.  Any  four  expres- 
sions of  above  accepted.  (Any  doubtful  answer  should  be  looked 
up  in  latest  immigration  rulings.) 

24.  To  supply  blood  with  oxygen,  to  carry  off  waste  material,  etc. 

25.  Any  answer  that  includes  the  idea  of  a  legislative  measure's  being 
referred  to  people. 

'  Although  the  question  calls  for  five  cities  with  a  population  of  over 
half  a  million,  it  was  marked  correct  if  three  such  cities  (starred  above) 
were  given,  together  with  three  other  large  cities  from  above  list. 

PRELIMINARY  SCALE  B 

1.  What  is  our  national  song? 

2.  Name  the  young  of  the  sheep,  cow,  horse. 

3.  Why  don't  we  see  the  stars  in  the  daytime? 

4.  Name  three  states  in  the  U.  S.  where  cotton  is  raised. 

5.  Name  four  different  trees. 

6.  What  is  the  correct  temperature  for  a  living  room? 

7.  In  what  month  of  the  year  do  the  days  begin  to  grow  shorter? 

8.  How  many  cents  are  there  in  a  quarter? 

9.  What  makes  cobwebs? 

10.  Where  does  Congress  meet? 

11.  Why  is  it  necessary  to  limit  the  hunting  season? 

12.  Of  what  is  butter  made? 

13.  In  what  part  of  the  day  are  the  shadows  longest? 

14.  Why  is  the  moon  light  at  night? 

15.  Draw  a  square  and  an  oblong, 

16.  What  is  the  capital  of  the  U.  S.? 

17.  Why  do  unsupported  objects  fall  to  the  ground? 

18.  What  is  the  largest  city  in  the  U.  S.? 

19.  How  can  you  tell  poison  ivy  by  looking  at  it? 

20.  About  how  often  do  we  have  a  full  moon? 

21.  How  many  pecks  are  there  in  a  bushel? 

22.  What  is  the  shortest  month  in  the  year? 

23.  Name  three  different  plants  from  which  sugar  is  made. 

24.  Of  what  use  are  insects  to  flowers? 

25.  What  is  the  youngest  age  at  which  a  child  can  leave  school? 

26.  Name  a  famous  American  inventor  and  tell  what  he  invented. 

27.  Name  two  stones  used  for  building  purposes. 

28.  What  are  the  four  seasons? 

29.  How  many  states  are  there  in  the  U.  S.? 

30.  Name  five  wild  flowers. 

31.  Why  does  seasoned  wood  burn  more  easily  than  green  wood? 
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32.  What  may  we  expect  when  we  see  heavy  black  clouds? 

33.  Tell  one  way  of  finding  out  the  age  of  a  tree. 

34.  Why  does  frost  form  on  the  inside  of  the  window  pane? 

35.  How  many  sides  has  a  triangle? 

36.  From  what  animal  do  we  get  mutton? 

37.  What  kind  of  cloth  is  made  from  flax? 

38.  From  what  does  maple  sugar  come? 

39.  Who  was  the  first  President  of  the  U.  S.? 

40.  Name  two  birds  that  stay  North  in  the  winter. 

41.  How  much  does  it  cost  to  mail  a  letter  to  any  city  in  the  U.  S.? 

42.  What  do  we  mix  with  ice  to  help  us  freeze  ice-cream  more  quickly? 

43.  How  do  sponges  grow? 

44.  How  can  you  keep  milk  from  souring? 

45.  What  do  the  stars  in  the  American  flag  represent? 

46.  Name  the  continents  in  order  of  size. 

47.  Give  one  reason  for  the  rotation  of  crops. 

48.  What  holiday  do  we  celebrate  that  was  first  celebrated  by  the  Pil- 


grims 


49.  Name  five  crops. 

50.  What  causes  an  eclipse  of  the  sun? 

51.  What  kind  of  dairy  cow  gives  the  richest  milk? 

52.  What  is  a  submarine  boat? 

53.  Why  should  we  kill  flies? 

54.  How  many  pints  are  there  in  a  quart? 

55.  Why  are  crops  hoed? 

56.  What  is  steam? 

57.  At  what  time  of  year  do  many  leaves  turn  red? 

58.  Name  three  products  made  from  wheat. 

59.  What  form  of  government  have  we  in  the  U.  S.? 

60.  Name  a  vegetable  that  grows  above  ground. 

61.  What  is  a  domestic  animal? 

62.  Why  do  we  celebrate  the  4th  of  July? 

63.  Of  what  is  paper  made? 

64.  Who  is  the  Governor  of  your  State? 

65.  What  artificial  waterway  connects  the  Atlantic  with  the  Pacific? 

66.  How  many  months  are  there  in  a  year? 

67.  Why  is  it  dark  at  night? 

68.  How  can  you  locate  the  Pole  star? 

69.  How  old  must  you  be  before  you  can  vote? 

70.  Name  a  country  in  Europe  which  is  a  Republic. 

71.  What  is  the  highest  court  in  the  U.  S.  called? 

72.  Of  what  is  rubber  made? 

73.  Who  was  the  President  of  the  U.  S.  during  the  World  War? 

74.  Name  two  animals  that  hibernate  in  winter. 

75.  What  is  the  economic  value  of  Alaska  to  the  U.  S.? 

76.  What  tree  doesn't  shed  its  leaves  in  the  Fall? 

77.  Name  two  differences  between  the  barks  of  birch  and  oak  trees. 

78.  Name  three  uses  of  forests. 

79.  Name  five  fruits. 

80.  How  many  weeks  are  there  in  a  year? 


PRELIMINARY  TEST— SCALED  INFORMATION  B 
Directions  for  Administration 
1.  There  are  three  sheets  of  this  preliminary  test.  Difficult  and  easy 
questions  are  scattered  throughout.  We  are  attempting  to  test  the  ques- 
tions rather  than  the  children.  So  it  is  very  important  that  each  ques- 
tion be  given  due  consideration  and  that  enough  time  be  given  for  all 
the  questions.  We  hope  that  you  can  give  these  tests  (page  by  page) 
directly  you  receive  them;  i.e.,  the  first  morning,  questions  1-25;  the 
second  morning,  questions  26-53;  the  third  morning,  questions  54-80. 
Fifteen  minutes  for  each  page  will  probably  be  sufficient. 


SPECIAL  REFERENCE  TO  URBAN  AND  RURAL  GROUPS   81 

2.  Say  to  the  children:  "Some  people  are  trying  to  find  out  what  sort 
of  questions  boys  and  girls  of  your  age  can  answer.  They  have  asked 
us  to  help  them.  I'm  going  to  give  each  of  you  a  set  of  questions. 
Don't  be  discouraged  because  you  can't  answer  all  the  questions,  but  be 
sure  to  do  as  many  as  you  can.  Try  every  question  on  the  whole  page. 
You  are  not  going  to  be  marked  on  your  answers.  In  fact,  you  don't 
have  to  put  your  name  on  the  paper  at  all.  Do  not  start  on  the  test 
until  I  tell  you  to  do  so." 

3.  Distribute  the  tests,  one  to  each  child.  Have  the  children  write  on 
one  of  the  top  lines  (in  the  box  in  the  upper  right  hand  corner)  Boy 
or  Girl.  Be  sure  that  each  child  gives  his  age  in  years  and  months,  and 
his  school  grade. 

4.  When  this  has  been  completed,  give  the  signal  to  commence  the 
test.  Do  not  give  any  help  whatsoever.  If  you  observe  any  child  cheat- 
ing, destroy  his  paper. 


SCALED  INFORMATION  B 
Directions  for  Administration 

1.  Please  give  this  test  on  the  morning  of  May  1  (or  as  near  then  as 
possible). 

2.  Say  to  the  children:  "Some  people  are  trying  to  find  out  what  sort 
of  questions  boys  and  girls  of  your  age  can  answer.  They  have  asked 
me  to  help  them.  I  am  going  to  give  each  of  you  a  set  of  questions. 
I  want  you  to  look  at  each  one  carefully  and  to  write  the  proper  answer 
in  the  space  beside  each  question.  Don't  be  discouraged  because  you  can't 
answer  all  the  questions,  but  be  sure  to  do  as  many  as  you  can.  You 
are  not  going  to  be  marked  on  your  answers.  In  fact,  you  don't  have 
to  put  your  name  on  the  paper  at  all.  Do  not  start  on  the  test  until  I 
tell  you  to  do  so." 

3.  Distribute  the  tests,  one  to  each  child.  Have  the  children  write  in 
the  box  in  the  upper  right-hand  corner,  Boy  or  Girl.  Be  sure  that  each 
child  gives  his  age  in  years  and  months,  and  his  school  grade. 

4.  When  this  has  been  completed,  give  the  signal  to  commence  the 
test.  Allow  15  Tninutes  only.  Do  not  give  any  help  whatever.  If  you 
observe  any  child  cheating,  destroy  his  paper. 

5.  After  fifteen  minutes  give  the  signal  to  stop.  Have  every  child 
turn  his  paper  over.  Tell  each  pupil  to  write  the  name  of  the  country 
where  he  was  born;  underneath  that,  the  name  of  the  country  where 
his  father  was  born;  and  underneath  that,  the  name  of  the  country 
where  his  mother  was  born. 


KEY  TO  SCALED  INFORMATION  B 

1.  Cream,  milk,  whey,  cream  and  salt. 

2.  Two  cents. 

3.  Spring,  summer,  autumn  (fall),  winter. 

4.  "Star   Spangled   Banner,"   "America,"   "My   Country,   'tis   of  thee," 
"Oh,  say,  can  you  see?" 

5.  Squash,  lettuce,  tomato,  cabbage,  string  beans,  peas,  cucumber,  etc. 

6.  Lamb,  calf,  colt  (pony,  foal,  filly) . 

7.  Salt. 

8.  Any  four  different  trees. 

9.  Sheep. 

10.  Dry,  dryer,  green  wood  is  wet,  crisp,  contains  less  water. 

11.  Any  five  crops. 

12.  Pine,  hemlock,  fir,  spruce,  liveoak,  cedar,  palm,  Christmas  tree,  ever- 
green, balsam. 

13.  Annual  rings,  rings,  lines  or  marks  in  stump,  cambium  layers,  lay- 
ers in  the  trunk,  size,  height,  tallness,  extent  of  the  roots,  rough- 
ness of  the  bark,  etc. 
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14.  Light  from  the  sun,  obscured  by  the  sun,  daylight  too  strong,  (Any 
answer  mentioning  brightness.) 

15.  Every  four  weeks,  or  month,  or  28  or  31  days.  Twelve  times  a  year, 
etc. 

16.  Any  five  flowers. 

17.  Fisheries,  minerals,  furs  or  valuable  skins,  gold,  coal,  salmon,  seals. 
Any  money  value  over  $5000  a  year. 

18.  Condensation  of  moisture,  warmer  inside,  steam  or  vapor  inside, 
heat  in  the  room,  heat  and  cold  come  together.  Relative  humidity 
of  air  inside  and  out. 

19.  Lumber,  wood,  fuel,  draw  water,  prevent  floods,  keep  soil  in  good 
condition,  prevent  landslides,  shade,  scenery  and  beauty,  recreation, 
camping  and  health  resorts,  animal  refuge  or  protection,  hunting, 
trapping,  home  for  birds,  tar,  petroleum,  cork,  dyes,  medicines  or 
chemicals  from  trees,  maple  sugar  or  sap,  windbreaker,  regulate 
temperature,  etc.     (Any  three.) 

20.  Wilson. 

21.  Replacement  of  nitrogen,  fertilization,  different  crops  use  up  differ- 
ent substances  in  the  soil,  keep  the  soil  from  becoming  exhausted, 
better  crops,  etc. 

22.  Sugar  cane,  beet,  maple,  sorghum,  palm,  corn,  grapes.     (Any  three.) 

23.  June. 

24.  Reflection  of  the  sun,  light  from  the  sun,  sun  shines  on  it,  etc. 

25.  Big  dipper,  dipper,  Great  Bear,  pointer  stars,  latitude,  compass. 
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